Aug 24 09:48:14 devstack cinder-volume[82973]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 24 09:48:14 devstack cinder-volume[82973]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 24 09:48:14 devstack cinder-volume[82973]: we strongly recommend against using it for new projects. Aug 24 09:48:14 devstack cinder-volume[82973]: If you are already using Eventlet, we recommend migrating to a different Aug 24 09:48:14 devstack cinder-volume[82973]: framework. For more detail see Aug 24 09:48:14 devstack cinder-volume[82973]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 24 09:48:14 devstack cinder-volume[82973]: import eventlet # noqa Aug 24 09:48:17 devstack cinder-volume[82973]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:48:17 devstack cinder-volume[82973]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:48:17 devstack cinder-volume[82973]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:48:18 devstack cinder-volume[82973]: INFO dbcounter [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Registered counter for database cinder Aug 24 09:48:18 devstack cinder-volume[82973]: DEBUG oslo_db.sqlalchemy.engines [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:48:18 devstack cinder-volume[82973]: DEBUG dbcounter [-] [82973] Writer thread running {{(pid=82973) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 24 09:48:18 devstack cinder-volume[82973]: INFO cinder.rpc [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 24 09:48:18 devstack cinder-volume[82973]: INFO cinder.rpc [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 24 09:48:18 devstack cinder-volume[82973]: DEBUG oslo_db.sqlalchemy.engines [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:48:18 devstack cinder-volume[82973]: INFO cinder.volume.manager [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Determined volume DB was empty at startup. Aug 24 09:48:18 devstack cinder-volume[82973]: DEBUG cinder.volume.manager [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82973) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 24 09:48:18 devstack cinder-volume[82973]: INFO cinder.volume.manager [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 24 09:48:18 devstack cinder-volume[82973]: WARNING stevedore.named [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 24 09:48:18 devstack cinder-volume[82973]: WARNING castellan.key_manager [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:48:18 devstack cinder-volume[82973]: WARNING cinder.keymgr.conf_key_mgr [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:48:18 devstack cinder-volume[82973]: DEBUG cinder.volume.drivers.lvm [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82973) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 24 09:48:18 devstack cinder-volume[82973]: DEBUG oslo_concurrency.processutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82973) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_concurrency.processutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=82973) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_db.sqlalchemy.engines [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:48:19 devstack cinder-volume[82973]: INFO cinder.rpc [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 24 09:48:19 devstack cinder-volume[82973]: INFO cinder.rpc [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 24 09:48:19 devstack cinder-volume[82973]: WARNING stevedore.named [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 24 09:48:19 devstack cinder-volume[82973]: WARNING castellan.key_manager [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:48:19 devstack cinder-volume[82973]: INFO cinder.volume.manager [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_db.sqlalchemy.engines [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82973) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:48:19 devstack cinder-volume[82973]: INFO oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Starting 1 workers Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Started child 83156 {{(pid=82973) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Full set of CONF: {{(pid=82973) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] ******************************************************************************** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Configuration options gathered from: {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] ================================================================================ {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] allow_availability_zone_fallback = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[83156]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] allow_compression_on_image_upload = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] allowed_direct_url_schemes = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] api_rate_limit = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] auth_strategy = keystone {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] az_cache_duration = 3600 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_availability_zone = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_host = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_stats_polling_interval = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backup_api_class = cinder.backup.api.API {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backup_name_template = backup-%s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backup_use_same_host = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backup_use_temp_snapshot = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] chap_password = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] chap_username = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_internal_tenant_project_id = c282ec5460b5401391d74620e7a61d0b {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_internal_tenant_user_id = 54b277e6806f4375a0248f2462204a88 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cloned_volume_same_az = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cluster = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] compression_format = gzip {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] compute_api_class = cinder.compute.nova.API {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] config_dir = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] config_source = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] control_exchange = openstack {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] debug = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] default_availability_zone = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] default_group_type = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] default_volume_type = lvmdriver-1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] disk_geometry = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] driver_client_cert = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] driver_client_cert_key = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] driver_data_namespace = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] driver_ssl_cert_path = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] driver_ssl_cert_verify = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] driver_use_ssl = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] enable_force_upload = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] enable_new_services = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] enable_unsupported_driver = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] enforce_multipath_for_image_xfer = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] filter_function = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_api_insecure = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_api_ssl_compression = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_ca_certificates_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_catalog_info = image:glance:publicURL {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_num_retries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance_request_timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] goodness_function = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] graceful_shutdown_timeout = 5 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] group_api_class = cinder.group.api.API {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] host = devstack {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_compress_on_upload = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_conversion_address_space_limit = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_conversion_cpu_limit = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_conversion_disable = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_upload_use_cinder_backend = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_upload_use_internal_tenant = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_volume_cache_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_volume_cache_max_count = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] image_volume_cache_max_size_gb = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] init_host_max_objects_retrieval = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] instance_format = [instance: %(uuid)s] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] iscsi_target_flags = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] iscsi_write_cache = on {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] iser_helper = tgtadm {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] iser_ip_address = 192.168.122.156 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] iser_port = 3260 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_color = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_config_append = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_dir = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_options = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_rotate_interval = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_rotate_interval_type = days {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] log_rotation_type = none {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] max_age = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] max_logfile_count = 30 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] max_logfile_size_mb = 200 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] max_over_subscription_ratio = 20.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] message_reap_interval = 86400 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] message_ttl = 2592000 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] migration_create_volume_timeout_secs = 300 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] monkey_patch = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] monkey_patch_modules = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[83156]: INFO cinder.volume.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] my_ip = 192.168.122.156 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] no_snapshot_gb_quota = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] num_iser_scan_tries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] num_shell_tries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] num_volume_device_scan_tries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] nvmeof_conn_info_version = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] nvmet_ns_id = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] nvmet_port_id = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_max_limit = 1000 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_volume_ext_list = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_volume_listen_port = 8776 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_volume_use_ssl = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] osapi_volume_workers = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] per_volume_size_limit = -1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] periodic_fuzzy_delay = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] periodic_interval = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] public_endpoint = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] publish_errors = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_backup_gigabytes = 1000 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_backups = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_gigabytes = 1000 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_groups = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_snapshots = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] quota_volumes = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] rate_limit_burst = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] rate_limit_except_level = CRITICAL {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] rate_limit_interval = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] reinit_driver_count = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] replication_device = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] report_discard_supported = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] report_interval = 120 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] reservation_clean_interval = 86400 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] reservation_expire = 86400 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] reserved_image_namespaces = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] reserved_percentage = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] rpc_response_timeout = 120 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] run_external_periodic_tasks = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] scst_target_driver = iscsi {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] scst_target_iqn_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_down_time = 720 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] shell_completion = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] snapshot_name_template = snapshot-%s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] snapshot_same_host = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] split_loggers = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] state_path = /opt/stack/data/cinder {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] storage_availability_zone = nova {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] storage_protocol = iSCSI {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] syslog_log_facility = LOG_USER {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] target_helper = lioadm {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] target_ip_address = 192.168.122.156 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] target_port = 3260 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] target_protocol = iscsi {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] target_secondary_ip_addresses = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] trace_flags = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] transport_url = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] until_refresh = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_chap_auth = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_default_quota_class = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_journal = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_json = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_multipath_for_image_xfer = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_stderr = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] use_syslog = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] verify_glance_signatures = enabled {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_api_class = cinder.volume.api.API {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_backend_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_clear = zero {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_clear_ionice = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_clear_size = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_copy_bps_limit = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_dd_blocksize = 1M {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_name_template = volume-%s {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_service_inithost_offload = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volume_usage_audit_period = month {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] zoning_mode = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_concurrency.disable_process_locking = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.auth_section = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.auth_type = password {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.auth_version = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.cache = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.include_service_catalog = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.insecure = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.interface = public {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_password = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcache_username = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.region_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.service_type = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.backend = dogpile.cache.null {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.backend_argument = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.backend_expiration_time = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.config_prefix = cache.oslo {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.debug_cache_backend = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.enable_retry_client = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.enable_socket_keepalive = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.expiration_time = 600 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.hashclient_retry_attempts = 2 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_dead_retry = 300 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_pool_maxsize = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_sasl_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.password = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.proxies = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.redis_db = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.redis_server = localhost:6379 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.retry_attempts = 2 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.retry_delay = 0.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.socket_keepalive_count = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.socket_keepalive_idle = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.socket_keepalive_interval = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.socket_timeout = 1.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.tls_allowed_ciphers = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.tls_cafile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.tls_certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.tls_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.tls_keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cache.username = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] coordination.backend_url = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.asyncio_connection = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.asyncio_slave_connection = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.backend = sqlalchemy {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.connection = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.connection_debug = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.connection_parameters = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.connection_recycle_time = 3600 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.connection_trace = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.db_inc_retry_interval = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.db_max_retries = 20 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.db_max_retry_interval = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.db_retry_interval = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.max_overflow = 50 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.max_pool_size = 5 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.max_retries = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.mysql_wsrep_sync_wait = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.pool_timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.retry_interval = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.slave_connection = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.sqlite_synchronous = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.synchronous_reader = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] database.use_db_reconnect = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.connection_string = messaging:// {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.es_doc_type = notification {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.es_scroll_size = 10000 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.es_scroll_time = 2m {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.filter_error_trace = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.hmac_keys = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.sentinel_service_name = mymaster {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.socket_timeout = 0.1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.trace_requests = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler.trace_sqlalchemy = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler_jaeger.process_tags = {} {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler_jaeger.service_name_prefix = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] profiler_otlp.service_name_prefix = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.enforce_new_defaults = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.policy_default_rule = default {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.policy_file = policy.yaml {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.group = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.helper_command = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] privsep_osbrick.user = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.group = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.helper_command = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] cinder_sys_admin.user = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.auth_section = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.auth_type = password {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.cafile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.collect_timing = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.insecure = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.send_service_user_token = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.split_loggers = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] service_user.timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.auth_section = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.auth_type = password {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.collect_timing = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.insecure = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.region_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.split_loggers = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] glance.timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.backend_availability_zone = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.chap_password = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.chap_username = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.disk_geometry = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.driver_client_cert = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.driver_client_cert_key = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.driver_data_namespace = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.driver_use_ssl = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.extra_capabilities = {} {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.filter_function = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.goodness_function = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack sudo[83183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.iscsi_target_flags = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.iscsi_write_cache = on {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.iser_helper = tgtadm {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.iser_port = 3260 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack sudo[83183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.lvm_share_target = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.lvm_type = auto {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.num_shell_tries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.replication_device = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.report_discard_supported = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.reserved_percentage = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.target_helper = tgtadm {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.target_port = 3260 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.target_protocol = iscsi {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.trace_flags = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.unique_fqdn_network = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.use_chap_auth = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_backend_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_clear = zero {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_clear_ionice = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_clear_size = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_reports.file_event_handler = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_reports.log_dir = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.backend_host = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.chap_password = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.chap_username = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.disk_geometry = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.driver_client_cert = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.extra_capabilities = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.filter_function = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.goodness_function = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.iser_helper = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.iser_ip_address = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.iser_port = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.lvm_share_target = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.lvm_type = auto {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.num_shell_tries = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.replication_device = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.report_discard_supported = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.reserved_percentage = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.scst_target_driver = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.storage_protocol = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.target_helper = lioadm {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.target_ip_address = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.target_port = 3260 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.trace_flags = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.use_chap_auth = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_clear = zero {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_clear_size = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] lvmdriver-1.volumes_dir = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:19 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_notifications.driver = [] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_notifications.retry = -1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] key_manager.fixed_key = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.barbican_api_version = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.barbican_endpoint = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.barbican_endpoint_type = public {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.barbican_region_name = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.cafile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.collect_timing = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.insecure = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.number_of_retries = 60 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.retry_delay = 1 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.send_service_user_token = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.split_loggers = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.verify_ssl = True {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican.verify_ssl_path = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.auth_section = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.auth_type = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.cafile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.certfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.collect_timing = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.insecure = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.keyfile = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.split_loggers = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] barbican_service_user.timeout = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.approle_role_id = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.approle_secret_id = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.auth_method = approle {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.auth_path = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.kv_mountpoint = secret {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.kv_path = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.kv_version = 2 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.namespace = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.root_token_id = **** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.ssl_ca_crt_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.timeout = 60.0 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.token_file = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.token_role = None {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.use_ssl = False {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:48:20 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] ******************************************************************************** {{(pid=82973) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 24 09:48:20 devstack sudo[83183]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.358s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:20 devstack sudo[83331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:20 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:20 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 09:48:20 devstack cinder-volume[83156]: INFO cinder.brick.local_dev.lvm [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:20 devstack sudo[83440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:48:20 devstack sudo[83440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:20 devstack sudo[83440]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG cinder.brick.local_dev.lvm [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83156) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 24 09:48:20 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:20 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:20 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:21 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:21 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:21 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:21 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:21 devstack sudo[83770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 24 09:48:21 devstack sudo[83770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:21 devstack sudo[83770]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.329s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:21 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:21 devstack sudo[83854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:48:21 devstack sudo[83854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:22 devstack sudo[83854]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:22 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:22 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:22 devstack sudo[83857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:48:22 devstack sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:22 devstack sudo[83857]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:22 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:22 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:22 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:22 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:22 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:22 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:22 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:22 devstack sudo[83949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:22 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:23 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:23 devstack sudo[83953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:23 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:23 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:23 devstack cinder-volume[83156]: INFO cinder.volume.drivers.lvm [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:23 devstack sudo[83958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:23 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:23 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:23 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:48:23 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:23 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:23 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:23 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:23 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:24 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:24 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:24 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:24 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:24 devstack sudo[83976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:24 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:24 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:24 devstack cinder-volume[83156]: INFO cinder.volume.driver [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Driver hasn't implemented _init_vendor_properties() Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG cinder.volume.driver [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83156) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_db.sqlalchemy.engines [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83156) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG dbcounter [-] [83156] Writer thread running {{(pid=83156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG cinder.db.api [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Building query based on filter {{(pid=83156) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG cinder.image.image_utils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83156) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 24 09:48:24 devstack cinder-volume[83156]: INFO cinder.keymgr.migration [None req-7e888a0f-d954-4674-8b9c-5a0676913ea1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:48:24 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:24 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:48:24 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:25 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:25 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:25 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:25 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:25 devstack sudo[83988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:25 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:25 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:25 devstack sudo[83993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:25 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:25 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:25 devstack cinder-volume[83156]: DEBUG cinder.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Notifying Schedulers of capabilities ... {{(pid=83156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:48:26 devstack cinder-volume[83156]: INFO cinder.volume.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Driver initialization completed successfully. Aug 24 09:48:26 devstack cinder-volume[83156]: INFO cinder.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Initiating service 2 cleanup Aug 24 09:48:26 devstack cinder-volume[83156]: INFO cinder.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Service 2 cleanup completed. Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG cinder.service [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Creating RPC server for service cinder-volume {{(pid=83156) start /opt/stack/cinder/cinder/service.py:231}} Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG cinder.service [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83156) start /opt/stack/cinder/cinder/service.py:237}} Aug 24 09:48:26 devstack cinder-volume[83156]: INFO cinder.volume.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:26 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:48:26 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:26 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:26 devstack sudo[83999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:26 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:26 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:26 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:26 devstack sudo[84002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:48:26 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:27 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:48:27 devstack sudo[84008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:48:27 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:48:27 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root Aug 24 09:48:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:48:27 devstack cinder-volume[83156]: INFO cinder.volume.manager [None req-eb16c513-1c89-4def-ae37-91afab0cce96 None None] Driver post RPC initialization completed successfully. Aug 24 09:48:29 devstack cinder-volume[82973]: DEBUG dbcounter [-] [82973] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82973) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:48:36 devstack cinder-volume[83156]: DEBUG dbcounter [-] [83156] Writing DB stats cinder:SELECT=2 {{(pid=83156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:48:37 devstack cinder-volume[83156]: DEBUG dbcounter [-] [83156] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:49:27 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:49:27 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:49:27 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:49:27 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:49:27 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:49:27 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:49:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:49:27 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:49:27 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:49:28 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:49:28 devstack sudo[86040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:49:28 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:49:28 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG cinder.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Notifying Schedulers of capabilities ... {{(pid=83156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager._thread_info {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG cinder.volume.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] thread count: 6 {{(pid=83156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:49:28 devstack cinder-volume[83156]: DEBUG cinder.volume.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] thread info: [<_MainThread(MainThread, started 129851259486336)>, , , , , ] {{(pid=83156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:50:27 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:50:27 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:50:27 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:50:27 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:50:27 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:50:27 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:50:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:50:27 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:50:27 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:50:28 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:50:28 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:50:28 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:50:28 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG cinder.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Notifying Schedulers of capabilities ... {{(pid=83156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager._thread_info {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG cinder.volume.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] thread count: 6 {{(pid=83156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:50:28 devstack cinder-volume[83156]: DEBUG cinder.volume.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] thread info: [<_MainThread(MainThread, started 129851259486336)>, , , , , ] {{(pid=83156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:50:37 devstack cinder-volume[83156]: DEBUG dbcounter [-] [83156] Writing DB stats cinder:SELECT=1 {{(pid=83156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:50:37 devstack cinder-volume[83156]: DEBUG dbcounter [-] [83156] Writing DB stats cinder:UPDATE=1 {{(pid=83156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:51:27 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:51:27 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:51:27 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:51:27 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:51:27 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:51:27 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:51:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:51:27 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:51:27 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:51:28 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:51:28 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:51:28 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:51:28 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG cinder.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Notifying Schedulers of capabilities ... {{(pid=83156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager._thread_info {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG cinder.volume.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] thread count: 6 {{(pid=83156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:51:28 devstack cinder-volume[83156]: DEBUG cinder.volume.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] thread info: [<_MainThread(MainThread, started 129851259486336)>, , , , , ] {{(pid=83156) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG oslo_service.periodic_task [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83156) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG cinder.volume.drivers.lvm [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Updating volume stats {{(pid=83156) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:27 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 24 09:52:27 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:27 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:27 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:52:27 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:27 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:27 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:27 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 24 09:52:27 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:28 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:28 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 24 09:52:28 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:28 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:28 devstack cinder-volume[83156]: DEBUG oslo_concurrency.processutils [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83156) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:28 devstack cinder-volume[83156]: DEBUG cinder.manager [None req-19fcbafb-18d5-4468-91bd-11c006c94e6d None None] Notifying Schedulers of capabilities ... {{(pid=83156) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:52:37 devstack cinder-volume[83156]: DEBUG dbcounter [-] [83156] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83156) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:52:48 devstack cinder-volume[82973]: INFO oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Caught SIGTERM, stopping children Aug 24 09:52:48 devstack cinder-volume[82973]: DEBUG oslo_concurrency.lockutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Acquiring lock "singleton_lock" {{(pid=82973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:52:48 devstack cinder-volume[82973]: DEBUG oslo_concurrency.lockutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Acquired lock "singleton_lock" {{(pid=82973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:52:48 devstack cinder-volume[82973]: DEBUG oslo_concurrency.lockutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Releasing lock "singleton_lock" {{(pid=82973) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:52:48 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Stop services. {{(pid=82973) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 24 09:52:48 devstack cinder-volume[82973]: DEBUG oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Killing children. {{(pid=82973) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 24 09:52:48 devstack cinder-volume[82973]: INFO oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Waiting on 1 children to exit Aug 24 09:52:51 devstack cinder-volume[83156]: DEBUG oslo_concurrency.lockutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Acquiring lock "singleton_lock" {{(pid=83156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:52:51 devstack cinder-volume[83156]: DEBUG oslo_concurrency.lockutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Acquired lock "singleton_lock" {{(pid=83156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:52:51 devstack cinder-volume[83156]: DEBUG oslo_concurrency.lockutils [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Releasing lock "singleton_lock" {{(pid=83156) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:52:51 devstack cinder-volume[83156]: WARNING amqp [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 24 09:52:51 devstack cinder-volume[83156]: WARNING amqp [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 24 09:52:51 devstack cinder-volume[82973]: INFO oslo_service.backend._eventlet.service [None req-52a576ca-1145-4289-bb45-f08ff1ce9433 None None] Child 83156 exited with status 0 Aug 24 09:52:51 devstack cinder-volume[93242]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 24 09:52:51 devstack cinder-volume[93242]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 24 09:52:51 devstack cinder-volume[93242]: we strongly recommend against using it for new projects. Aug 24 09:52:51 devstack cinder-volume[93242]: If you are already using Eventlet, we recommend migrating to a different Aug 24 09:52:51 devstack cinder-volume[93242]: framework. For more detail see Aug 24 09:52:51 devstack cinder-volume[93242]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 24 09:52:51 devstack cinder-volume[93242]: import eventlet # noqa Aug 24 09:52:53 devstack cinder-volume[93242]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:52:53 devstack cinder-volume[93242]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:52:53 devstack cinder-volume[93242]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:52:54 devstack cinder-volume[93242]: INFO dbcounter [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Registered counter for database cinder Aug 24 09:52:54 devstack cinder-volume[93242]: DEBUG oslo_db.sqlalchemy.engines [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:52:54 devstack cinder-volume[93242]: DEBUG dbcounter [-] [93242] Writer thread running {{(pid=93242) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 24 09:52:54 devstack cinder-volume[93242]: INFO cinder.rpc [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 24 09:52:54 devstack cinder-volume[93242]: INFO cinder.rpc [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 24 09:52:54 devstack cinder-volume[93242]: DEBUG oslo_db.sqlalchemy.engines [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:52:54 devstack cinder-volume[93242]: INFO cinder.volume.manager [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Determined volume DB was empty at startup. Aug 24 09:52:54 devstack cinder-volume[93242]: DEBUG cinder.volume.manager [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93242) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 24 09:52:54 devstack cinder-volume[93242]: INFO cinder.volume.manager [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 24 09:52:54 devstack cinder-volume[93242]: WARNING stevedore.named [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 24 09:52:54 devstack cinder-volume[93242]: WARNING castellan.key_manager [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:52:54 devstack cinder-volume[93242]: WARNING cinder.keymgr.conf_key_mgr [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:52:54 devstack cinder-volume[93242]: INFO cinder.volume.manager [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_db.sqlalchemy.engines [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93242) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:52:55 devstack cinder-volume[93242]: INFO oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Starting 1 workers Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Started child 93458 {{(pid=93242) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Full set of CONF: {{(pid=93242) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] ******************************************************************************** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Configuration options gathered from: {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] ================================================================================ {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] allow_availability_zone_fallback = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] allow_compression_on_image_upload = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] allowed_direct_url_schemes = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93458]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] api_rate_limit = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] auth_strategy = keystone {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_availability_zone = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_host = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_stats_polling_interval = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backup_api_class = cinder.backup.api.API {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backup_name_template = backup-%s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backup_use_same_host = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backup_use_temp_snapshot = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] chap_password = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] chap_username = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_internal_tenant_project_id = c282ec5460b5401391d74620e7a61d0b {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_internal_tenant_user_id = 54b277e6806f4375a0248f2462204a88 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cluster = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] compression_format = gzip {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] compute_api_class = cinder.compute.nova.API {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] config_dir = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] config_source = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] control_exchange = openstack {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] debug = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] default_availability_zone = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] default_group_type = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] default_volume_type = QuobyteHD {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] disk_geometry = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] driver_client_cert = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] driver_client_cert_key = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] driver_data_namespace = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] driver_ssl_cert_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] driver_ssl_cert_verify = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] driver_use_ssl = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] enable_new_services = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] enable_unsupported_driver = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] enabled_backends = ['QuobyteHD'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] enforce_multipath_for_image_xfer = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] filter_function = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_api_insecure = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_api_ssl_compression = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_ca_certificates_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_catalog_info = image:glance:publicURL {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_num_retries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance_request_timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] goodness_function = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] graceful_shutdown_timeout = 5 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] group_api_class = cinder.group.api.API {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] host = devstack {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_compress_on_upload = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_conversion_address_space_limit = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_conversion_cpu_limit = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_conversion_disable = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_upload_use_cinder_backend = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_upload_use_internal_tenant = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_volume_cache_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_volume_cache_max_count = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] image_volume_cache_max_size_gb = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] init_host_max_objects_retrieval = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] instance_format = [instance: %(uuid)s] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] iscsi_target_flags = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] iscsi_write_cache = on {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] iser_helper = tgtadm {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] iser_ip_address = 192.168.122.156 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] iser_port = 3260 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_color = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_config_append = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_dir = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_options = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93458]: INFO cinder.volume.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Starting volume driver QuobyteDriver (1.2) Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.remotefs [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93458) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_rotate_interval = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_rotate_interval_type = days {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] log_rotation_type = none {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] max_age = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] max_logfile_count = 30 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] max_logfile_size_mb = 200 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] max_over_subscription_ratio = 20.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] message_reap_interval = 86400 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] message_ttl = 2592000 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] migration_create_volume_timeout_secs = 300 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] monkey_patch = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] monkey_patch_modules = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] my_ip = 192.168.122.156 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] no_snapshot_gb_quota = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] num_iser_scan_tries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] num_shell_tries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] num_volume_device_scan_tries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] nvmeof_conn_info_version = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] nvmet_ns_id = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] nvmet_port_id = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_max_limit = 1000 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_volume_ext_list = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_volume_listen = 0.0.0.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_volume_listen_port = 8776 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_volume_use_ssl = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] osapi_volume_workers = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] per_volume_size_limit = -1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] periodic_fuzzy_delay = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] periodic_interval = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] project_id_regex = [0-9a-f\-]+ {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] public_endpoint = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] publish_errors = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_backup_gigabytes = 1000 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_backups = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_gigabytes = 1000 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_groups = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_snapshots = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] quota_volumes = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] rate_limit_burst = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] rate_limit_except_level = CRITICAL {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] rate_limit_interval = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] reinit_driver_count = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] replication_device = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] report_discard_supported = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] report_interval = 120 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] reservation_clean_interval = 86400 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] reservation_expire = 86400 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] reserved_image_namespaces = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] reserved_percentage = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] rpc_response_timeout = 120 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] run_external_periodic_tasks = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] scst_target_driver = iscsi {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] scst_target_iqn_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_down_time = 720 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] shell_completion = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] snapshot_name_template = snapshot-%s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] split_loggers = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] state_path = /opt/stack/data/cinder {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] storage_availability_zone = nova {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] storage_protocol = iSCSI {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] syslog_log_facility = LOG_USER {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] target_helper = lioadm {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] target_ip_address = 192.168.122.156 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] target_port = 3260 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] target_protocol = iscsi {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] target_secondary_ip_addresses = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] trace_flags = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] transfer_api_class = cinder.transfer.api.API {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] transport_url = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] until_refresh = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_chap_auth = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_default_quota_class = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_journal = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_json = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_multipath_for_image_xfer = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_stderr = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] use_syslog = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] verify_glance_signatures = enabled {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_api_class = cinder.volume.api.API {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_backend_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_clear = zero {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_clear_ionice = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_clear_size = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_copy_bps_limit = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_dd_blocksize = 1M {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_name_template = volume-%s {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_service_inithost_offload = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volume_usage_audit_period = month {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] zoning_mode = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_concurrency.disable_process_locking = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.auth_section = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.auth_type = password {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.auth_version = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.cache = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.delay_auth_decision = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.http_connect_timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.include_service_catalog = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.insecure = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.interface = public {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_password = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcache_username = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.region_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.service_token_roles_required = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.service_type = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.token_cache_time = 300 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.backend = dogpile.cache.null {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.backend_argument = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.backend_expiration_time = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.config_prefix = cache.oslo {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.debug_cache_backend = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.enable_retry_client = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.enable_socket_keepalive = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93458) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 24 09:52:55 devstack cinder-volume[93458]: WARNING cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 24 09:52:55 devstack cinder-volume[93458]: WARNING cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.expiration_time = 600 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.hashclient_retry_attempts = 2 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_dead_retry = 300 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_pool_maxsize = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Running cmd (subprocess): mount.quobyte {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_sasl_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.password = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.proxies = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.redis_db = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.redis_sentinel_service_name = mymaster {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.redis_server = localhost:6379 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.retry_attempts = 2 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.retry_delay = 0.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.socket_keepalive_count = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.socket_keepalive_idle = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.socket_keepalive_interval = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.socket_timeout = 1.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.tls_allowed_ciphers = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.tls_cafile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.tls_certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.tls_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.tls_keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cache.username = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] coordination.backend_url = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.asyncio_connection = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.asyncio_slave_connection = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.backend = sqlalchemy {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.connection = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.connection_debug = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.connection_parameters = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.connection_recycle_time = 3600 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.connection_trace = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.db_inc_retry_interval = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.db_max_retries = 20 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.db_max_retry_interval = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.db_retry_interval = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.max_overflow = 50 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.max_pool_size = 5 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.max_retries = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.mysql_wsrep_sync_wait = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.pool_timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.retry_interval = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.slave_connection = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.sqlite_synchronous = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.synchronous_reader = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] database.use_db_reconnect = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.connection_string = messaging:// {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.es_doc_type = notification {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.es_scroll_size = 10000 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.es_scroll_time = 2m {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.filter_error_trace = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.hmac_keys = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.sentinel_service_name = mymaster {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.socket_timeout = 0.1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.trace_requests = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler.trace_sqlalchemy = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler_jaeger.process_tags = {} {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler_jaeger.service_name_prefix = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] profiler_otlp.service_name_prefix = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.enforce_new_defaults = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.policy_default_rule = default {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.policy_file = policy.yaml {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_policy.remote_timeout = 60.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.group = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.helper_command = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] privsep_osbrick.user = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.group = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.helper_command = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] cinder_sys_admin.user = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.auth_section = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.auth_type = password {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.cafile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.collect_timing = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.insecure = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.send_service_user_token = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.split_loggers = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] service_user.timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.auth_section = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.auth_type = password {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.collect_timing = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.insecure = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.region_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.split_loggers = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] glance.timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.backend_availability_zone = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.chap_password = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.chap_username = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.disk_geometry = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.driver_client_cert = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.driver_client_cert_key = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.driver_data_namespace = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.driver_use_ssl = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.enable_unsupported_driver = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.extra_capabilities = {} {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.filter_function = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.goodness_function = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.iscsi_target_flags = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.iscsi_write_cache = on {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.iser_helper = tgtadm {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.iser_port = 3260 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_host = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_login = admin {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_mount_options = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_password = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_private_key = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_share_path = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_ssh_port = 22 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.num_shell_tries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.nvmet_port_id = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_client_cfg = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] CMD "mount.quobyte" returned: 1 in 0.146s {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=93458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93458]: INFO cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c ... Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 -c /etc/quobyte/client-cinder.cfg {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.quobyte_volume_url = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.replication_device = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.report_discard_supported = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.reserved_percentage = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.scst_target_driver = iscsi {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.scst_target_iqn_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.storage_protocol = iSCSI {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.target_helper = tgtadm {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.target_port = 3260 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.target_protocol = iscsi {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.trace_flags = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.unique_fqdn_network = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.use_chap_auth = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_backend_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_clear = zero {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_clear_ionice = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_clear_size = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_reports.file_event_handler = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_reports.log_dir = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.backend_availability_zone = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.backend_host = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.chap_password = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.chap_username = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.chiscsi_conf = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.disk_geometry = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.driver_client_cert = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.driver_client_cert_key = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 -c /etc/quobyte/client-cinder.cfg Aug 24 09:52:55 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.driver_data_namespace = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.driver_use_ssl = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.extra_capabilities = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.filter_function = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.goodness_function = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.iscsi_target_flags = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.iscsi_write_cache = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.iser_helper = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.iser_ip_address = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.iser_port = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.iser_target_prefix = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_host = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_login = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_mount_options = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_password = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_private_key = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_share_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_ssh_port = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.num_shell_tries = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nvmet_ns_id = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.nvmet_port_id = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.replication_device = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.report_discard_supported = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.reserved_percentage = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.scst_target_driver = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.storage_protocol = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.target_helper = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.target_ip_address = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.target_port = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.target_prefix = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.target_protocol = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.trace_flags = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.unique_fqdn_network = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.use_chap_auth = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_clear = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_clear_ionice = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_clear_size = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] QuobyteHD.volumes_dir = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.ssl_version = {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_notifications.driver = [] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_notifications.retry = -1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] oslo_messaging_notifications.transport_url = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] key_manager.fixed_key = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.barbican_api_version = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.barbican_endpoint = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.barbican_endpoint_type = public {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.barbican_region_name = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.cafile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.collect_timing = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.insecure = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.number_of_retries = 60 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.retry_delay = 1 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.send_service_user_token = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.split_loggers = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.verify_ssl = True {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican.verify_ssl_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.auth_section = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.auth_type = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.cafile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.certfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.collect_timing = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.insecure = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.keyfile = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.split_loggers = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] barbican_service_user.timeout = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.approle_role_id = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.approle_secret_id = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.auth_method = approle {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.auth_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.kv_mountpoint = secret {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.kv_path = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.kv_version = 2 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.namespace = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.root_token_id = **** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.ssl_ca_crt_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.timeout = 60.0 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.token_file = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.token_role = None {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.use_ssl = False {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:52:55 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] ******************************************************************************** {{(pid=93242) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 24 09:52:55 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:55 devstack cinder-volume[93458]: INFO cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c succeeded Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=93458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.407s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:52:55 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:55 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:52:55 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:56 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.245s {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.volume.driver [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Driver hasn't implemented _init_vendor_properties() Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.volume.driver [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1269989013672, 'free_capacity_gb': 1775.1269989013672, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93458) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_db.sqlalchemy.engines [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93458) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG dbcounter [-] [93458] Writer thread running {{(pid=93458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.db.api [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Building query based on filter {{(pid=93458) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.image.image_utils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93458) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.keymgr.migration [None req-73daca34-7a38-4228-ab79-59d7bdeac859 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=93458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=93458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:56 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:52:56 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:56 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.240s {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Notifying Schedulers of capabilities ... {{(pid=93458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.volume.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Driver initialization completed successfully. Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Initiating service 3 cleanup Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Service 3 cleanup completed. Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.service [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Creating RPC server for service cinder-volume {{(pid=93458) start /opt/stack/cinder/cinder/service.py:231}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.service [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93458) start /opt/stack/cinder/cinder/service.py:237}} Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.volume.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=93458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=93458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:52:56 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:52:56 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:52:56 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Aug 24 09:52:56 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.254s {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:52:56 devstack cinder-volume[93458]: INFO cinder.volume.manager [None req-7f07ffe2-6dbd-42b2-b19a-3638a03c38ca None None] Driver post RPC initialization completed successfully. Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=93458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG cinder.volume.drivers.quobyte [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=93458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:53:01 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:53:01 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:53:01 devstack cinder-volume[93242]: INFO oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Caught SIGTERM, stopping children Aug 24 09:53:01 devstack cinder-volume[93242]: DEBUG oslo_concurrency.lockutils [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Acquiring lock "singleton_lock" {{(pid=93242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:53:01 devstack cinder-volume[93242]: DEBUG oslo_concurrency.lockutils [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Acquired lock "singleton_lock" {{(pid=93242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:53:01 devstack cinder-volume[93242]: DEBUG oslo_concurrency.lockutils [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Releasing lock "singleton_lock" {{(pid=93242) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:53:01 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Stop services. {{(pid=93242) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 24 09:53:01 devstack cinder-volume[93242]: DEBUG oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Killing children. {{(pid=93242) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 24 09:53:01 devstack cinder-volume[93242]: INFO oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Waiting on 1 children to exit Aug 24 09:53:01 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG oslo_concurrency.processutils [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.249s {{(pid=93458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:53:01 devstack cinder-volume[93458]: DEBUG cinder.manager [None req-1d3f9402-da67-413f-97aa-12787edb3f1c None None] Notifying Schedulers of capabilities ... {{(pid=93458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:53:04 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Acquiring lock "singleton_lock" {{(pid=93458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:53:04 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Acquired lock "singleton_lock" {{(pid=93458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:53:04 devstack cinder-volume[93458]: DEBUG oslo_concurrency.lockutils [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Releasing lock "singleton_lock" {{(pid=93458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:53:04 devstack cinder-volume[93458]: WARNING amqp [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 24 09:53:04 devstack cinder-volume[93458]: WARNING amqp [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 24 09:53:04 devstack cinder-volume[93242]: INFO oslo_service.backend._eventlet.service [None req-bf2410db-a5d8-47c1-be4a-7f39acf21f1f None None] Child 93458 exited with status 0 Aug 24 09:53:05 devstack cinder-volume[93742]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 24 09:53:05 devstack cinder-volume[93742]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 24 09:53:05 devstack cinder-volume[93742]: we strongly recommend against using it for new projects. Aug 24 09:53:05 devstack cinder-volume[93742]: If you are already using Eventlet, we recommend migrating to a different Aug 24 09:53:05 devstack cinder-volume[93742]: framework. For more detail see Aug 24 09:53:05 devstack cinder-volume[93742]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 24 09:53:05 devstack cinder-volume[93742]: import eventlet # noqa Aug 24 09:53:08 devstack cinder-volume[93742]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93742) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 24 09:53:08 devstack cinder-volume[93742]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93742) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 24 09:53:08 devstack cinder-volume[93742]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93742) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 24 09:53:09 devstack cinder-volume[93742]: INFO dbcounter [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Registered counter for database cinder Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG dbcounter [-] [93742] Writer thread running {{(pid=93742) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 24 09:53:09 devstack cinder-volume[93742]: INFO cinder.rpc [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 24 09:53:09 devstack cinder-volume[93742]: INFO cinder.rpc [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:53:09 devstack cinder-volume[93742]: INFO cinder.volume.manager [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Determined volume DB was empty at startup. Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG cinder.volume.manager [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93742) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 24 09:53:09 devstack cinder-volume[93742]: WARNING stevedore.named [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 24 09:53:09 devstack cinder-volume[93742]: WARNING castellan.key_manager [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:53:09 devstack cinder-volume[93742]: WARNING cinder.keymgr.conf_key_mgr [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 24 09:53:09 devstack cinder-volume[93742]: INFO cinder.volume.manager [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:53:09 devstack cinder-volume[93742]: INFO oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Starting 1 workers Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Started child 94039 {{(pid=93742) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Full set of CONF: {{(pid=93742) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] ******************************************************************************** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] Configuration options gathered from: {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] ================================================================================ {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 24 09:53:09 devstack cinder-volume[94039]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] allow_availability_zone_fallback = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] allow_compression_on_image_upload = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] allowed_direct_url_schemes = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] api_rate_limit = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] auth_strategy = keystone {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_availability_zone = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_host = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_stats_polling_interval = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backup_api_class = cinder.backup.api.API {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backup_name_template = backup-%s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backup_use_same_host = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backup_use_temp_snapshot = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] chap_password = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] chap_username = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_internal_tenant_project_id = c282ec5460b5401391d74620e7a61d0b {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_internal_tenant_user_id = 54b277e6806f4375a0248f2462204a88 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cluster = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] compression_format = gzip {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] compute_api_class = cinder.compute.nova.API {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] config_dir = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] config_source = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] control_exchange = openstack {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] debug = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] default_availability_zone = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] default_group_type = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] default_volume_type = QuobyteHD {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] disk_geometry = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] driver_client_cert = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] driver_client_cert_key = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] driver_data_namespace = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] driver_ssl_cert_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] driver_ssl_cert_verify = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] driver_use_ssl = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] enable_new_services = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] enable_unsupported_driver = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] enabled_backends = ['QuobyteHD'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] enforce_multipath_for_image_xfer = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] filter_function = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_api_insecure = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_api_ssl_compression = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_ca_certificates_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_catalog_info = image:glance:publicURL {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_num_retries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance_request_timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] goodness_function = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] graceful_shutdown_timeout = 5 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] group_api_class = cinder.group.api.API {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] host = devstack {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_compress_on_upload = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_conversion_address_space_limit = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_conversion_cpu_limit = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_conversion_disable = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_upload_use_cinder_backend = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_upload_use_internal_tenant = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_volume_cache_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_volume_cache_max_count = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] image_volume_cache_max_size_gb = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] init_host_max_objects_retrieval = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] instance_format = [instance: %(uuid)s] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] iscsi_target_flags = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] iscsi_write_cache = on {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] iser_helper = tgtadm {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] iser_ip_address = 192.168.122.156 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] iser_port = 3260 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_color = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_config_append = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_dir = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_options = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_rotate_interval = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_rotate_interval_type = days {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] log_rotation_type = none {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Starting volume driver QuobyteDriver (1.2) Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94039) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] max_age = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] max_logfile_count = 30 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] max_logfile_size_mb = 200 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] max_over_subscription_ratio = 20.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] message_reap_interval = 86400 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] message_ttl = 2592000 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] migration_create_volume_timeout_secs = 300 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] monkey_patch = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] monkey_patch_modules = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] my_ip = 192.168.122.156 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] no_snapshot_gb_quota = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] num_iser_scan_tries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] num_shell_tries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] num_volume_device_scan_tries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] nvmeof_conn_info_version = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] nvmet_ns_id = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] nvmet_port_id = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_max_limit = 1000 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_volume_ext_list = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_volume_listen = 0.0.0.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_volume_listen_port = 8776 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_volume_use_ssl = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] osapi_volume_workers = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] per_volume_size_limit = -1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] periodic_fuzzy_delay = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] periodic_interval = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] project_id_regex = [0-9a-f\-]+ {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] public_endpoint = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] publish_errors = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_backup_gigabytes = 1000 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_backups = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_gigabytes = 1000 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_groups = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:09 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_snapshots = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] quota_volumes = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] rate_limit_burst = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] rate_limit_except_level = CRITICAL {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] rate_limit_interval = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] reinit_driver_count = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] replication_device = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] report_discard_supported = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] report_interval = 120 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] reservation_clean_interval = 86400 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] reservation_expire = 86400 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] reserved_image_namespaces = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] reserved_percentage = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] rpc_response_timeout = 120 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] run_external_periodic_tasks = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] scst_target_driver = iscsi {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] scst_target_iqn_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_down_time = 720 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] shell_completion = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] snapshot_name_template = snapshot-%s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] split_loggers = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] state_path = /opt/stack/data/cinder {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] storage_availability_zone = nova {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] storage_protocol = iSCSI {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] syslog_log_facility = LOG_USER {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] target_helper = lioadm {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] target_ip_address = 192.168.122.156 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] target_port = 3260 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] target_protocol = iscsi {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] target_secondary_ip_addresses = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] trace_flags = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] transfer_api_class = cinder.transfer.api.API {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] transport_url = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] until_refresh = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_chap_auth = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_default_quota_class = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_journal = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_json = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_multipath_for_image_xfer = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_stderr = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] use_syslog = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] verify_glance_signatures = enabled {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_api_class = cinder.volume.api.API {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_backend_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_clear = zero {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_clear_ionice = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_clear_size = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_copy_bps_limit = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_dd_blocksize = 1M {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_name_template = volume-%s {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_service_inithost_offload = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volume_usage_audit_period = month {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] zoning_mode = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_concurrency.disable_process_locking = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.auth_section = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.auth_type = password {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.auth_version = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.cache = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.delay_auth_decision = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.http_connect_timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.include_service_catalog = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.insecure = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.interface = public {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_password = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcache_username = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.region_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.service_token_roles_required = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.service_type = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.token_cache_time = 300 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.backend = dogpile.cache.null {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.backend_argument = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.backend_expiration_time = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.config_prefix = cache.oslo {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.debug_cache_backend = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.enable_retry_client = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.enable_socket_keepalive = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.expiration_time = 600 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.hashclient_retry_attempts = 2 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_dead_retry = 300 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_pool_maxsize = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94039) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_sasl_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.password = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.proxies = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.redis_db = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.redis_sentinel_service_name = mymaster {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.redis_server = localhost:6379 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.retry_attempts = 2 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.retry_delay = 0.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.socket_keepalive_count = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.socket_keepalive_idle = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.socket_keepalive_interval = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.socket_timeout = 1.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.tls_allowed_ciphers = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.tls_cafile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.tls_certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.tls_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.tls_keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cache.username = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] coordination.backend_url = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.asyncio_connection = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.asyncio_slave_connection = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Running cmd (subprocess): mount.quobyte {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.backend = sqlalchemy {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.connection = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.connection_debug = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.connection_parameters = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.connection_recycle_time = 3600 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.connection_trace = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.db_inc_retry_interval = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.db_max_retries = 20 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.db_max_retry_interval = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.db_retry_interval = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.max_overflow = 50 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.max_pool_size = 5 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.max_retries = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.mysql_wsrep_sync_wait = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.pool_timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.retry_interval = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.slave_connection = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.sqlite_synchronous = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.synchronous_reader = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] database.use_db_reconnect = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.connection_string = messaging:// {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.es_doc_type = notification {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.es_scroll_size = 10000 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.es_scroll_time = 2m {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.filter_error_trace = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.hmac_keys = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.sentinel_service_name = mymaster {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.socket_timeout = 0.1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.trace_requests = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler.trace_sqlalchemy = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler_jaeger.process_tags = {} {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler_jaeger.service_name_prefix = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] profiler_otlp.service_name_prefix = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.enforce_new_defaults = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.policy_default_rule = default {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.policy_file = policy.yaml {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_policy.remote_timeout = 60.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.group = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.helper_command = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] privsep_osbrick.user = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.group = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.helper_command = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] cinder_sys_admin.user = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.auth_section = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.auth_type = password {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.cafile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.collect_timing = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.insecure = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.send_service_user_token = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.split_loggers = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] service_user.timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.auth_section = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.auth_type = password {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.collect_timing = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.insecure = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.region_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.split_loggers = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] glance.timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.backend_availability_zone = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.chap_password = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.chap_username = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.disk_geometry = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.driver_client_cert = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.driver_client_cert_key = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.driver_data_namespace = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.driver_use_ssl = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.enable_unsupported_driver = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.extra_capabilities = {} {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.filter_function = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.goodness_function = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.iscsi_target_flags = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.iscsi_write_cache = on {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.iser_helper = tgtadm {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.iser_port = 3260 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_host = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_login = admin {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_mount_options = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_password = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_private_key = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_share_path = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_ssh_port = 22 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack quobyte-client[94040]: Reading configuration file: /etc/quobyte/client.cfg Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.num_shell_tries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.nvmet_port_id = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_client_cfg = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack quobyte-client[94040]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.quobyte_volume_url = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.replication_device = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.report_discard_supported = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.reserved_percentage = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.scst_target_driver = iscsi {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.scst_target_iqn_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.storage_protocol = iSCSI {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.target_helper = tgtadm {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.target_port = 3260 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.target_protocol = iscsi {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.trace_flags = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.unique_fqdn_network = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.use_chap_auth = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_backend_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_clear = zero {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_clear_ionice = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_clear_size = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_reports.file_event_handler = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_reports.log_dir = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.backend_availability_zone = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.backend_host = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.chap_password = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.chap_username = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.chiscsi_conf = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.disk_geometry = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.driver_client_cert = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.driver_client_cert_key = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.driver_data_namespace = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.driver_use_ssl = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.extra_capabilities = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.filter_function = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.goodness_function = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.iscsi_target_flags = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.iscsi_write_cache = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.iser_helper = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.iser_ip_address = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.iser_port = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.iser_target_prefix = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_host = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_login = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_mount_options = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_password = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_private_key = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_share_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_ssh_port = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.num_shell_tries = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nvmet_ns_id = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.nvmet_port_id = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.replication_device = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.report_discard_supported = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.reserved_percentage = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.scst_target_driver = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.storage_protocol = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.target_helper = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.target_ip_address = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.target_port = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.target_prefix = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.target_protocol = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.trace_flags = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.unique_fqdn_network = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.use_chap_auth = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_clear = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_clear_ionice = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_clear_size = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] QuobyteHD.volumes_dir = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.ssl_version = {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_notifications.driver = [] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_notifications.retry = -1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] oslo_messaging_notifications.transport_url = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] key_manager.fixed_key = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.barbican_api_version = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.barbican_endpoint = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.barbican_endpoint_type = public {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.barbican_region_name = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.cafile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.collect_timing = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.insecure = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.number_of_retries = 60 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.retry_delay = 1 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.send_service_user_token = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.split_loggers = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.verify_ssl = True {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican.verify_ssl_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.auth_section = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.auth_type = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.cafile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.certfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.collect_timing = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.insecure = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.keyfile = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.split_loggers = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] barbican_service_user.timeout = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.approle_role_id = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.approle_secret_id = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.auth_method = approle {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.auth_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.kv_mountpoint = secret {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.kv_path = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.kv_version = 2 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.namespace = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.root_token_id = **** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.ssl_ca_crt_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.timeout = 60.0 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.token_file = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.token_role = None {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.use_ssl = False {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 24 09:53:10 devstack cinder-volume[93742]: DEBUG oslo_service.backend._eventlet.service [None req-ed8fd0f6-dafe-45a8-b561-85e7191b538b None None] ******************************************************************************** {{(pid=93742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 24 09:53:10 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.281s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:53:10 devstack cinder-volume[94039]: INFO cinder.volume.driver [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Driver hasn't implemented _init_vendor_properties() Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.driver [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1266860961914, 'free_capacity_gb': 1775.1266860961914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94039) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_db.sqlalchemy.engines [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94039) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writer thread running {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.db.api [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Building query based on filter {{(pid=94039) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94039) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:53:10 devstack cinder-volume[94039]: INFO cinder.keymgr.migration [None req-d80fd5cb-f088-45a5-90d3-067497fea4dd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 24 09:53:10 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:53:10 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:53:10 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.230s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:53:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Driver initialization completed successfully. Aug 24 09:53:10 devstack cinder-volume[94039]: INFO cinder.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Initiating service 3 cleanup Aug 24 09:53:10 devstack cinder-volume[94039]: INFO cinder.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Service 3 cleanup completed. Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.service [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Creating RPC server for service cinder-volume {{(pid=94039) start /opt/stack/cinder/cinder/service.py:231}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.service [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94039) start /opt/stack/cinder/cinder/service.py:237}} Aug 24 09:53:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:53:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:53:10 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:53:10 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:53:11 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Aug 24 09:53:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:53:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-563672a6-c3be-4a7d-b042-c14404998c98 None None] Driver post RPC initialization completed successfully. Aug 24 09:53:19 devstack cinder-volume[93742]: DEBUG dbcounter [-] [93742] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93742) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:53:20 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:53:21 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:53:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:53:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 6 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:53:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Flow 'volume_create_manager' (61450bfe-2aee-4015-bab5-2df47c09c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69b56c4-fd15-45cc-8306-80dbd83f6677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69b56c4-fd15-45cc-8306-80dbd83f6677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-309249415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4c09d9-7f18-46eb-9c8e-5b6e095274cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f886a9027748778b082f74d82f6ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:54:09Z,use_quota=True,user_id='d3c94c85cf504ebc90476694e7e562c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8140f82-7ad9-42e6-9c66-f79f1867578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8140f82-7ad9-42e6-9c66-f79f1867578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97bdd34-ecc3-483d-8343-9d4ed381faa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97bdd34-ecc3-483d-8343-9d4ed381faa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4c09d9-7f18-46eb-9c8e-5b6e095274cf', 'volume_name': 'volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520beefd-04be-4230-98a3-8d007998b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (520beefd-04be-4230-98a3-8d007998b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91e370b-2eef-43c2-ae36-dc834f62ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:09 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Volume 1a4c09d9-7f18-46eb-9c8e-5b6e095274cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf', 'volume_size': 1} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-309249415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4c09d9-7f18-46eb-9c8e-5b6e095274cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f886a9027748778b082f74d82f6ac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:54:09Z,use_quota=True,user_id='d3c94c85cf504ebc90476694e7e562c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Creating volume 1a4c09d9-7f18-46eb-9c8e-5b6e095274cf {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:54:09 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:54:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:09 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf 1073741824 Aug 24 09:54:09 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf 1073741824" returned: 0 in 0.752s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:10 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:10 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf Aug 24 09:54:10 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:10 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf" returned: 0 in 0.346s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91e370b-2eef-43c2-ae36-dc834f62ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3cb1bb-f863-4119-a80c-dccf9f9520a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Volume volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf (1a4c09d9-7f18-46eb-9c8e-5b6e095274cf): created successfully Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3cb1bb-f863-4119-a80c-dccf9f9520a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Flow 'volume_create_manager' (61450bfe-2aee-4015-bab5-2df47c09c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:54:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b48e886d-d658-41d2-b163-50a11e618458 tempest-TaggedAttachmentsTest-1907195451 None] Created volume successfully. Aug 24 09:54:20 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:54:20 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Flow 'volume_create_manager' (fc85b755-1400-4e88-b73e-0e3a9d8c03cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6371bebf-91c9-4173-8b68-9a5d0cc6d349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6371bebf-91c9-4173-8b68-9a5d0cc6d349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1323816344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e23e9f2-ff98-4a5a-8c28-98aed92874d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7d03f6d1b34829b2ff27ca59ef8bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:54:24Z,use_quota=True,user_id='3e1f48b6b4e44b888e147b627ed69a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59437156-3116-49b6-9cbb-20556674ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59437156-3116-49b6-9cbb-20556674ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211dfbb2-5517-406b-a18a-39a3f8c30b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211dfbb2-5517-406b-a18a-39a3f8c30b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e23e9f2-ff98-4a5a-8c28-98aed92874d0', 'volume_name': 'volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf06c44-c367-4faa-8db3-c27459e4e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf06c44-c367-4faa-8db3-c27459e4e446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c42cb47-6083-4aec-8387-b25ac1e150f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Volume 6e23e9f2-ff98-4a5a-8c28-98aed92874d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0', 'volume_size': 1} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1323816344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e23e9f2-ff98-4a5a-8c28-98aed92874d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da7d03f6d1b34829b2ff27ca59ef8bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:54:24Z,use_quota=True,user_id='3e1f48b6b4e44b888e147b627ed69a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Creating volume 6e23e9f2-ff98-4a5a-8c28-98aed92874d0 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:54:24 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:54:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:24 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 1073741824 Aug 24 09:54:24 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:25 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 1073741824" returned: 0 in 1.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:25 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 Aug 24 09:54:25 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:26 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:54:26 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:26 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0" returned: 0 in 1.129s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] <== create_volume: return (2514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:54:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.516s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c42cb47-6083-4aec-8387-b25ac1e150f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c8c60-f829-493f-95a6-3dbbd09ab8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:27 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Volume volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 (6e23e9f2-ff98-4a5a-8c28-98aed92874d0): created successfully Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c8c60-f829-493f-95a6-3dbbd09ab8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Flow 'volume_create_manager' (fc85b755-1400-4e88-b73e-0e3a9d8c03cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:54:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-582e25a0-e4d1-4f5a-8e3b-f624dfbeb204 tempest-DeleteServersTestJSON-251298493 None] Created volume successfully. Aug 24 09:54:27 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 1.101s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 6 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:54:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:54:35 devstack cinder-volume[94039]: WARNING py.warnings [req-83b0a5d3-cac2-492d-ac12-7cb927772cdb req-f658fed8-f21d-4228-b94b-a614df13e709 tempest-DeleteServersTestJSON-251298493 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 24 09:54:35 devstack cinder-volume[94039]: .first() Aug 24 09:54:35 devstack cinder-volume[94039]: Aug 24 09:54:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-83b0a5d3-cac2-492d-ac12-7cb927772cdb req-f658fed8-f21d-4228-b94b-a614df13e709 tempest-DeleteServersTestJSON-251298493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-83b0a5d3-cac2-492d-ac12-7cb927772cdb req-f658fed8-f21d-4228-b94b-a614df13e709 tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-83b0a5d3-cac2-492d-ac12-7cb927772cdb req-f658fed8-f21d-4228-b94b-a614df13e709 tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-83b0a5d3-cac2-492d-ac12-7cb927772cdb req-f658fed8-f21d-4228-b94b-a614df13e709 tempest-DeleteServersTestJSON-251298493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e2e5a4-50d1-445c-be25-70bb6a0d0efc', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:54:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-83b0a5d3-cac2-492d-ac12-7cb927772cdb req-f658fed8-f21d-4228-b94b-a614df13e709 tempest-DeleteServersTestJSON-251298493 None] attachment_update completed successfully. Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Flow 'volume_create_manager' (ddf40cd4-90cb-48a7-b87d-40caab2ed70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40b7720-48e0-4c38-8064-86c6c35f2e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40b7720-48e0-4c38-8064-86c6c35f2e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1295758626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec6699e-8db3-4806-bfee-d7249fc40515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5c77eed6a9432195807b243b9dfa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:54:41Z,use_quota=True,user_id='b9bab763c6ee47abac987dc7521f485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bc0b55-96fe-4455-b8ff-53901e8ee8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bc0b55-96fe-4455-b8ff-53901e8ee8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7930fefe-a8bd-4ac0-b99b-2eb2736db2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7930fefe-a8bd-4ac0-b99b-2eb2736db2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec6699e-8db3-4806-bfee-d7249fc40515', 'volume_name': 'volume-5ec6699e-8db3-4806-bfee-d7249fc40515', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e005939-5fef-47b3-9d82-6eb2316882b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e005939-5fef-47b3-9d82-6eb2316882b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74209d8d-b97a-4e92-a3d7-cef114345dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:41 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Volume 5ec6699e-8db3-4806-bfee-d7249fc40515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec6699e-8db3-4806-bfee-d7249fc40515', 'volume_size': 1} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1295758626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec6699e-8db3-4806-bfee-d7249fc40515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5c77eed6a9432195807b243b9dfa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:54:41Z,use_quota=True,user_id='b9bab763c6ee47abac987dc7521f485c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Creating volume 5ec6699e-8db3-4806-bfee-d7249fc40515 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:54:41 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:54:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:41 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 1073741824 Aug 24 09:54:41 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:42 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 1073741824" returned: 0 in 1.035s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:42 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 Aug 24 09:54:42 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:42 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515" returned: 0 in 0.484s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74209d8d-b97a-4e92-a3d7-cef114345dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec6699e-8db3-4806-bfee-d7249fc40515', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfc0548-0122-45a2-a696-108ffddcd741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:54:42 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Volume volume-5ec6699e-8db3-4806-bfee-d7249fc40515 (5ec6699e-8db3-4806-bfee-d7249fc40515): created successfully Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfc0548-0122-45a2-a696-108ffddcd741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:54:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Flow 'volume_create_manager' (ddf40cd4-90cb-48a7-b87d-40caab2ed70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:54:42 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-454d74ec-e904-408c-833a-c4b4e95246a1 tempest-ServerRescueNegativeTestJSON-716476167 None] Created volume successfully. Aug 24 09:54:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-f5049c86-97d0-4748-8b44-0ad6389dfc99 req-160c807a-1533-402e-950f-d0645790d722 tempest-DeleteServersTestJSON-251298493 None] Terminate volume connection completed successfully. Aug 24 09:54:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-f5049c86-97d0-4748-8b44-0ad6389dfc99 req-160c807a-1533-402e-950f-d0645790d722 tempest-DeleteServersTestJSON-251298493 None] Deleting attachment b0e2e5a4-50d1-445c-be25-70bb6a0d0efc. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:54:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Acquiring lock "cinder-6e23e9f2-ff98-4a5a-8c28-98aed92874d0-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:54:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Lock "cinder-6e23e9f2-ff98-4a5a-8c28-98aed92874d0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:54:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Acquiring lock "cinder-quobyte-6e23e9f2-ff98-4a5a-8c28-98aed92874d0" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:54:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Lock "cinder-quobyte-6e23e9f2-ff98-4a5a-8c28-98aed92874d0" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:54:47 devstack cinder-volume[94039]: INFO oslo.privsep.daemon [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8gb1x99_/privsep.sock'] Aug 24 09:54:47 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8gb1x99_/privsep.sock Aug 24 09:54:47 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: Aug 24 09:54:49 devstack cinder-volume[94039]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 24 09:54:49 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:49 devstack cinder-volume[94039]: INFO oslo.privsep.daemon [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Spawned new privsep daemon via rootwrap Aug 24 09:54:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Accepted privsep connection to /tmp/tmp8gb1x99_/privsep.sock {{(pid=94039) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 24 09:54:49 devstack cinder-volume[94039]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 24 09:54:49 devstack cinder-volume[94039]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 24 09:54:49 devstack cinder-volume[94039]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 24 09:54:49 devstack cinder-volume[94039]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95940 Aug 24 09:54:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[875bd8fe-5c1d-4c95-804d-7274a1c83c89]: (2,) {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:54:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aa0e43-224e-4b9f-af69-451fe5fa357f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:54:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:49 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 Aug 24 09:54:49 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:50 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0" returned: 0 in 0.736s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:50 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0 Aug 24 09:54:50 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:50 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6e23e9f2-ff98-4a5a-8c28-98aed92874d0" returned: 0 in 0.662s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Lock "cinder-quobyte-6e23e9f2-ff98-4a5a-8c28-98aed92874d0" released by "delete_volume" :: held 3.571s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:54:51 devstack cinder-volume[94039]: WARNING cinder.quota [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:54:51 devstack cinder-volume[94039]: WARNING cinder.quota [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Created reservations ['4f368cc5-44e1-4f54-88ba-d454c2759010', '3342c0f7-c57e-45f4-b9e4-6093c7a51063', 'f1c46b3f-849f-4448-98be-4b2cef038132', 'b47dcca3-10fa-44b5-b8b3-7f5d6702d7f5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:54:51 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:54:51 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:54:51 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.652s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:54:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Deleted volume successfully. Aug 24 09:54:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7cb9fabb-2e9e-4347-95bb-e57eb5a84b8a tempest-DeleteServersTestJSON-251298493 None] Lock "cinder-6e23e9f2-ff98-4a5a-8c28-98aed92874d0-delete_volume" released by "delete_volume" :: held 4.597s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:55:01 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=21,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:55:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Acquiring lock "cinder-5ec6699e-8db3-4806-bfee-d7249fc40515-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:55:01 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=16,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:55:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "cinder-5ec6699e-8db3-4806-bfee-d7249fc40515-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:55:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Acquiring lock "cinder-quobyte-5ec6699e-8db3-4806-bfee-d7249fc40515" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:55:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "cinder-quobyte-5ec6699e-8db3-4806-bfee-d7249fc40515" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:55:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62845a7-76c5-4f6f-9cb9-4fd0dc47bc0a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:55:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:55:02 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 Aug 24 09:55:02 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:55:02 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Aug 24 09:55:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515" returned: 0 in 0.561s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:55:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:55:02 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515 Aug 24 09:55:02 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:55:03 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5ec6699e-8db3-4806-bfee-d7249fc40515" returned: 0 in 0.447s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "cinder-quobyte-5ec6699e-8db3-4806-bfee-d7249fc40515" released by "delete_volume" :: held 1.077s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Created reservations ['a3fb8417-ae82-41d6-a8a9-9d07fb870873', 'b8be81ef-255c-46f2-98d2-846eb45643b4', '29091003-a857-4269-986e-0238550d1fc6', '577533f8-41ca-4d7d-8bde-ea58bd0075de'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:55:03 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:55:03 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:55:03 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:55:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Deleted volume successfully. Aug 24 09:55:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c6cc16f4-e43b-4226-8c1e-3e59704ee952 tempest-ServerRescueNegativeTestJSON-716476167 None] Lock "cinder-5ec6699e-8db3-4806-bfee-d7249fc40515-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:55:13 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:55:21 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:55:26 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:55:26 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:55:26 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:55:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:55:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-4f031ba2-4536-46a8-a37e-808dca67d4f5 req-59be2eb3-2ad7-4735-a286-a29d58bd14f8 tempest-TaggedAttachmentsTest-1907195451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:55:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-4f031ba2-4536-46a8-a37e-808dca67d4f5 req-59be2eb3-2ad7-4735-a286-a29d58bd14f8 tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:55:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-4f031ba2-4536-46a8-a37e-808dca67d4f5 req-59be2eb3-2ad7-4735-a286-a29d58bd14f8 tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:55:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-4f031ba2-4536-46a8-a37e-808dca67d4f5 req-59be2eb3-2ad7-4735-a286-a29d58bd14f8 tempest-TaggedAttachmentsTest-1907195451 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18bfdd72-ce36-4c52-a4a3-9ce2d10159c8', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:55:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-4f031ba2-4536-46a8-a37e-808dca67d4f5 req-59be2eb3-2ad7-4735-a286-a29d58bd14f8 tempest-TaggedAttachmentsTest-1907195451 None] attachment_update completed successfully. Aug 24 09:55:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-d0d024dd-0c2f-41b7-9030-d3919c739309 req-a7429c75-c5f6-4273-b377-b7609d532e32 tempest-TaggedAttachmentsTest-1907195451 None] Terminate volume connection completed successfully. Aug 24 09:55:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-d0d024dd-0c2f-41b7-9030-d3919c739309 req-a7429c75-c5f6-4273-b377-b7609d532e32 tempest-TaggedAttachmentsTest-1907195451 None] Deleting attachment 18bfdd72-ce36-4c52-a4a3-9ce2d10159c8. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:55:40 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=8 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:55:45 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:56:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Acquiring lock "cinder-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:56:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Lock "cinder-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Acquiring lock "cinder-quobyte-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Lock "cinder-quobyte-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0652ba19-7194-4b47-b709-78e006a64f92]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:02 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf Aug 24 09:56:02 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:02 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf" returned: 0 in 0.681s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:02 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf Aug 24 09:56:02 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:02 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Flow 'volume_create_manager' (2c501a34-9677-4741-9d5a-0c2dcd99de36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e97b93c-2c52-45bf-b424-39c7a7bed510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e97b93c-2c52-45bf-b424-39c7a7bed510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-5434395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb4b76f-df84-440b-8c6c-f56c1f94537c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342499f0a8a94fb68cb62eca9a1b7ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:56:03Z,use_quota=True,user_id='73c9786bbc5347f5b08349264b6d765a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54cd107-a2b8-49c3-aba6-d7e0b47b4c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54cd107-a2b8-49c3-aba6-d7e0b47b4c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ebfd74-a583-4e13-89e1-c036e79acb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8ebfd74-a583-4e13-89e1-c036e79acb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb4b76f-df84-440b-8c6c-f56c1f94537c', 'volume_name': 'volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:03 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc42bd-2c2d-4858-920a-13c238996273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc42bd-2c2d-4858-920a-13c238996273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e0c433-e032-4a35-a592-8829c8b74943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Volume 0eb4b76f-df84-440b-8c6c-f56c1f94537c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c', 'volume_size': 1} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-5434395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb4b76f-df84-440b-8c6c-f56c1f94537c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342499f0a8a94fb68cb62eca9a1b7ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:56:03Z,use_quota=True,user_id='73c9786bbc5347f5b08349264b6d765a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Creating volume 0eb4b76f-df84-440b-8c6c-f56c1f94537c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:56:03 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf" returned: 0 in 0.475s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Lock "cinder-quobyte-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf" released by "delete_volume" :: held 1.239s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:56:03 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c 1073741824 Aug 24 09:56:03 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Created reservations ['19841229-7fef-4cb9-8ae5-b3d980aeaf31', '4ff22ac8-fb13-44df-8273-fdc5807f6ad7', 'e0c1ea22-5f41-4ac8-830c-4989ba018cc7', '902ba4c4-ca1e-43d5-9901-c6ec650691af'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:03 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:56:03 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:03 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:03 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:56:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Deleted volume successfully. Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4978a14c-6b5f-4f3e-a534-a473b083727d tempest-TaggedAttachmentsTest-1907195451 None] Lock "cinder-1a4c09d9-7f18-46eb-9c8e-5b6e095274cf-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:56:04 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c 1073741824" returned: 0 in 0.887s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:04 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c Aug 24 09:56:04 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:04 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c" returned: 0 in 0.393s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71e0c433-e032-4a35-a592-8829c8b74943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f682ff5a-46ca-405a-8bc7-0182c62af97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Volume volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c (0eb4b76f-df84-440b-8c6c-f56c1f94537c): created successfully Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f682ff5a-46ca-405a-8bc7-0182c62af97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Flow 'volume_create_manager' (2c501a34-9677-4741-9d5a-0c2dcd99de36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:56:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c2313b9f-25a8-474c-903a-83fb878e87b9 tempest-VolumesAdminNegativeTest-996957389 None] Created volume successfully. Aug 24 09:56:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Acquiring lock "cinder-0eb4b76f-df84-440b-8c6c-f56c1f94537c-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:56:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Lock "cinder-0eb4b76f-df84-440b-8c6c-f56c1f94537c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:56:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Acquiring lock "cinder-quobyte-0eb4b76f-df84-440b-8c6c-f56c1f94537c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:56:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Lock "cinder-quobyte-0eb4b76f-df84-440b-8c6c-f56c1f94537c" acquired by "delete_volume" :: waited 0.042s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:56:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf12a76f-2e61-4442-b9c0-baf37fb30078]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:56:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:06 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c Aug 24 09:56:06 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:07 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c" returned: 0 in 1.152s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:07 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c Aug 24 09:56:07 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:07 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb4b76f-df84-440b-8c6c-f56c1f94537c" returned: 0 in 0.536s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Lock "cinder-quobyte-0eb4b76f-df84-440b-8c6c-f56c1f94537c" released by "delete_volume" :: held 1.779s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Created reservations ['6947f0df-4038-4832-a0e2-09ee5e3eee12', 'cbedbf25-9ce5-4420-b32f-71ac042580c6', '6c65680a-c295-4ec7-bba6-5590991a3980', 'cea78d49-6593-482a-aa98-cf8dfc8aef67'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:08 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:56:08 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:08 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.407s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:56:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Deleted volume successfully. Aug 24 09:56:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-664bb512-e867-4982-8464-4d5aad8b9bc6 tempest-VolumesAdminNegativeTest-996957389 None] Lock "cinder-0eb4b76f-df84-440b-8c6c-f56c1f94537c-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:56:18 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=13,cinder:UPDATE=21,cinder:INSERT=6 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:56:18 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=11,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Flow 'volume_create_manager' (3427349a-d4c8-49c2-b63a-059e68acffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e633ff2d-1943-4616-8319-1f7029e4d5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e633ff2d-1943-4616-8319-1f7029e4d5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-418468297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a928bc1-0595-46c5-9dc6-ed8f081a41ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566535e0a20940b7b78811ec1c29e9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:56:20Z,use_quota=True,user_id='62dd657679f64536a352a14123be0f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ee1cf9-4b32-4dc3-be61-747cfe8b0c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ee1cf9-4b32-4dc3-be61-747cfe8b0c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9922aa-4301-43c9-9a42-0233f7427794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9922aa-4301-43c9-9a42-0233f7427794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a928bc1-0595-46c5-9dc6-ed8f081a41ed', 'volume_name': 'volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2c6a73-8032-4d77-9aa8-0c5c8ab00813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2c6a73-8032-4d77-9aa8-0c5c8ab00813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fd79cb-d243-49a3-a1ad-dafe35773647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Volume 8a928bc1-0595-46c5-9dc6-ed8f081a41ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed', 'volume_size': 1} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-418468297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a928bc1-0595-46c5-9dc6-ed8f081a41ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566535e0a20940b7b78811ec1c29e9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:56:20Z,use_quota=True,user_id='62dd657679f64536a352a14123be0f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Creating volume 8a928bc1-0595-46c5-9dc6-ed8f081a41ed {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:56:19 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:56:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:19 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed 1073741824 Aug 24 09:56:19 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:20 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed 1073741824" returned: 0 in 0.742s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:20 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed Aug 24 09:56:20 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:21 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fd79cb-d243-49a3-a1ad-dafe35773647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2857ab98-900f-413b-b324-802d06b3af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Volume volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed (8a928bc1-0595-46c5-9dc6-ed8f081a41ed): created successfully Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2857ab98-900f-413b-b324-802d06b3af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Flow 'volume_create_manager' (3427349a-d4c8-49c2-b63a-059e68acffdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:56:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f8fdc8d0-bc4a-4033-9237-4dd1a4931e7b tempest-ServerActionsTestOtherA-873819248 None] Created volume successfully. Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:26 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:56:26 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:26 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.453s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 8 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:56:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:56:31 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:56:31 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Flow 'volume_create_manager' (ac743651-7801-46ae-bb24-1b14fb509f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4685f5-d229-41c4-a27b-2eb1d8d70aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4685f5-d229-41c4-a27b-2eb1d8d70aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-695659928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474ee22-c2ba-4c19-82be-ddaee4c0616a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c000cea4804977b21e80c48c1070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:56:35Z,use_quota=True,user_id='0b40e9a77a2d421894ab94b7c9d64070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889f8f79-afac-4d0b-8a74-eb3205ee973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889f8f79-afac-4d0b-8a74-eb3205ee973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39cc030-c523-4957-b0e3-725e46e04ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39cc030-c523-4957-b0e3-725e46e04ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4474ee22-c2ba-4c19-82be-ddaee4c0616a', 'volume_name': 'volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311d920c-f826-466b-a3f4-844c58989cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311d920c-f826-466b-a3f4-844c58989cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea3cf8-ddb2-4bba-aba6-250f5e82b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:34 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Volume 4474ee22-c2ba-4c19-82be-ddaee4c0616a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a', 'volume_size': 1} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-695659928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474ee22-c2ba-4c19-82be-ddaee4c0616a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c000cea4804977b21e80c48c1070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:56:35Z,use_quota=True,user_id='0b40e9a77a2d421894ab94b7c9d64070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Creating volume 4474ee22-c2ba-4c19-82be-ddaee4c0616a {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:56:34 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:56:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:34 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a 1073741824 Aug 24 09:56:34 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:35 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a 1073741824" returned: 0 in 0.584s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:56:35 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a Aug 24 09:56:35 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:56:35 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a" returned: 0 in 0.375s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea3cf8-ddb2-4bba-aba6-250f5e82b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10361d6-0266-472f-904b-58620c551312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:56:35 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Volume volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a (4474ee22-c2ba-4c19-82be-ddaee4c0616a): created successfully Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10361d6-0266-472f-904b-58620c551312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:56:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Flow 'volume_create_manager' (ac743651-7801-46ae-bb24-1b14fb509f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:56:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-37430d54-5b76-419a-999e-6a578c3c2af1 tempest-AttachVolumeTestJSON-1788094156 None] Created volume successfully. Aug 24 09:56:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-63a7389f-e16c-4290-9ab4-33c289fae3fa req-cd8f5191-0a43-4f05-a8c3-816b14057fe0 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:56:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-63a7389f-e16c-4290-9ab4-33c289fae3fa req-cd8f5191-0a43-4f05-a8c3-816b14057fe0 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:56:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-63a7389f-e16c-4290-9ab4-33c289fae3fa req-cd8f5191-0a43-4f05-a8c3-816b14057fe0 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:56:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-63a7389f-e16c-4290-9ab4-33c289fae3fa req-cd8f5191-0a43-4f05-a8c3-816b14057fe0 tempest-AttachVolumeTestJSON-1788094156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '438ed8a0-de24-49f1-acdc-f6ca31b24149', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:56:38 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-63a7389f-e16c-4290-9ab4-33c289fae3fa req-cd8f5191-0a43-4f05-a8c3-816b14057fe0 tempest-AttachVolumeTestJSON-1788094156 None] attachment_update completed successfully. Aug 24 09:56:48 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:56:48 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:57:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-227a26c4-b8a9-432c-9347-488f06c49115 req-24106fd5-6aed-42bd-9ef6-31bb35e14959 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-227a26c4-b8a9-432c-9347-488f06c49115 req-24106fd5-6aed-42bd-9ef6-31bb35e14959 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-227a26c4-b8a9-432c-9347-488f06c49115 req-24106fd5-6aed-42bd-9ef6-31bb35e14959 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-227a26c4-b8a9-432c-9347-488f06c49115 req-24106fd5-6aed-42bd-9ef6-31bb35e14959 tempest-ServerActionsTestOtherA-873819248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9486a205-21df-40e1-8a22-0b1c87e52049', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:57:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-227a26c4-b8a9-432c-9347-488f06c49115 req-24106fd5-6aed-42bd-9ef6-31bb35e14959 tempest-ServerActionsTestOtherA-873819248 None] attachment_update completed successfully. Aug 24 09:57:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-33786d32-0ec9-472d-980e-cce7e9f9083c tempest-ServerActionsTestOtherA-873819248 None] Terminate volume connection completed successfully. Aug 24 09:57:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-33786d32-0ec9-472d-980e-cce7e9f9083c tempest-ServerActionsTestOtherA-873819248 None] Deleting attachment 9486a205-21df-40e1-8a22-0b1c87e52049. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:57:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-d501f194-0907-4436-84fc-13d4e6a7b2fd tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-d501f194-0907-4436-84fc-13d4e6a7b2fd tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-d501f194-0907-4436-84fc-13d4e6a7b2fd tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-d501f194-0907-4436-84fc-13d4e6a7b2fd tempest-ServerActionsTestOtherA-873819248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '142910db-c7d3-4aee-8b21-e085fd6f7092', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:57:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-1562dbd3-e3c6-4b1f-92f9-c3c39904dd72 req-d501f194-0907-4436-84fc-13d4e6a7b2fd tempest-ServerActionsTestOtherA-873819248 None] attachment_update completed successfully. Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Flow 'volume_create_manager' (a41450e6-ce9f-4ba9-a9f7-291997d7e2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebffaed-bcbc-4c8a-a19c-ce9599294167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ebffaed-bcbc-4c8a-a19c-ce9599294167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945630607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37a2080-90e2-4097-9c2e-4ddcb2d672c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73bfac8587604fdea85612c5a38dd83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:18Z,use_quota=True,user_id='7c503e8ff3cd41dc87f7174cb103b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e434fb56-cdb2-4247-b600-29e0b6c1f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e434fb56-cdb2-4247-b600-29e0b6c1f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c3da3-7281-4458-a618-42a21a5af1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4c3da3-7281-4458-a618-42a21a5af1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37a2080-90e2-4097-9c2e-4ddcb2d672c3', 'volume_name': 'volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5033a6a-3e34-499e-b4ee-c921ec2c7ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5033a6a-3e34-499e-b4ee-c921ec2c7ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88ea7a8-b8e8-4edf-9744-1b120945025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:18 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Volume f37a2080-90e2-4097-9c2e-4ddcb2d672c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3', 'volume_size': 1} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1945630607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37a2080-90e2-4097-9c2e-4ddcb2d672c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73bfac8587604fdea85612c5a38dd83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:18Z,use_quota=True,user_id='7c503e8ff3cd41dc87f7174cb103b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Creating volume f37a2080-90e2-4097-9c2e-4ddcb2d672c3 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:57:18 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:57:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:18 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 1073741824 Aug 24 09:57:18 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:19 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 1073741824" returned: 0 in 0.994s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:19 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 Aug 24 09:57:19 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:20 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3" returned: 0 in 0.639s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88ea7a8-b8e8-4edf-9744-1b120945025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc74a41-ad47-4b88-afae-683ef6e31891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Volume volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 (f37a2080-90e2-4097-9c2e-4ddcb2d672c3): created successfully Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc74a41-ad47-4b88-afae-683ef6e31891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Flow 'volume_create_manager' (a41450e6-ce9f-4ba9-a9f7-291997d7e2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0cd9d29d-7a6d-428e-9bc3-1dcc4945a21f tempest-ServersNegativeTestJSON-239521811 None] Created volume successfully. Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Flow 'volume_create_manager' (e82c7d8c-3c4d-414b-a081-d88ce337c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1debdd2a-7dee-47e2-9c6d-8a4ea72d42b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1debdd2a-7dee-47e2-9c6d-8a4ea72d42b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1884858858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fd8e18-8da9-4359-914a-e6ca9abbafaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73bfac8587604fdea85612c5a38dd83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:23Z,use_quota=True,user_id='7c503e8ff3cd41dc87f7174cb103b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce48f74-ea26-4132-8bd1-36e5152968fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce48f74-ea26-4132-8bd1-36e5152968fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf2e1de-d8dd-4a88-a2e5-1857c09da805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf2e1de-d8dd-4a88-a2e5-1857c09da805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fd8e18-8da9-4359-914a-e6ca9abbafaf', 'volume_name': 'volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65576189-42f5-4232-91d7-844b67c8f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65576189-42f5-4232-91d7-844b67c8f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25974b87-5b7e-46dc-a878-20561066ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:22 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Volume 69fd8e18-8da9-4359-914a-e6ca9abbafaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf', 'volume_size': 1} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1884858858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fd8e18-8da9-4359-914a-e6ca9abbafaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73bfac8587604fdea85612c5a38dd83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:23Z,use_quota=True,user_id='7c503e8ff3cd41dc87f7174cb103b5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Creating volume 69fd8e18-8da9-4359-914a-e6ca9abbafaf {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:57:22 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:57:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:23 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf 1073741824 Aug 24 09:57:23 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:23 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf 1073741824" returned: 0 in 0.674s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:23 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf Aug 24 09:57:23 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:24 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf" returned: 0 in 0.429s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25974b87-5b7e-46dc-a878-20561066ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602e5df9-8db5-4322-adc1-46d48a922759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Volume volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf (69fd8e18-8da9-4359-914a-e6ca9abbafaf): created successfully Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602e5df9-8db5-4322-adc1-46d48a922759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Flow 'volume_create_manager' (e82c7d8c-3c4d-414b-a081-d88ce337c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-654f4af1-f37e-4b75-be08-8b9d727da053 tempest-ServersNegativeTestJSON-239521811 None] Created volume successfully. Aug 24 09:57:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "cinder-69fd8e18-8da9-4359-914a-e6ca9abbafaf-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-69fd8e18-8da9-4359-914a-e6ca9abbafaf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "cinder-quobyte-69fd8e18-8da9-4359-914a-e6ca9abbafaf" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-quobyte-69fd8e18-8da9-4359-914a-e6ca9abbafaf" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fae0d0-90f5-4794-884d-06510e5bb560]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:57:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:25 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf Aug 24 09:57:25 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:26 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:26 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf Aug 24 09:57:26 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:26 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:57:26 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:26 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-69fd8e18-8da9-4359-914a-e6ca9abbafaf" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-quobyte-69fd8e18-8da9-4359-914a-e6ca9abbafaf" released by "delete_volume" :: held 1.068s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Created reservations ['950fca52-e726-4e7e-9bd0-83d1c8e2f2c6', '4f98ae4f-117b-4c82-b51d-43a3594b45be', 'bff70bcd-ccf5-4331-bd40-5e08279f121e', '0f5f5174-a625-45ad-b06b-2cad1c105497'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:26 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:57:26 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:26 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.716s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 8 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:57:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:57:27 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.366s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:57:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Deleted volume successfully. Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-26ec38a2-2922-4fed-9b1c-f06ade663a73 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-69fd8e18-8da9-4359-914a-e6ca9abbafaf-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "cinder-f37a2080-90e2-4097-9c2e-4ddcb2d672c3-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-f37a2080-90e2-4097-9c2e-4ddcb2d672c3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "cinder-quobyte-f37a2080-90e2-4097-9c2e-4ddcb2d672c3" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-quobyte-f37a2080-90e2-4097-9c2e-4ddcb2d672c3" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12834255-14a9-441a-a62c-0579442c6467]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:57:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:28 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 Aug 24 09:57:28 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:28 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3" returned: 0 in 0.350s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:28 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3 Aug 24 09:57:28 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:28 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f37a2080-90e2-4097-9c2e-4ddcb2d672c3" returned: 0 in 0.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-quobyte-f37a2080-90e2-4097-9c2e-4ddcb2d672c3" released by "delete_volume" :: held 0.693s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Created reservations ['7fb75861-9139-42a6-8855-60abd26f32aa', 'cf912212-cee1-411d-86f5-e086c2e36fb8', '2c1365d4-7cdf-4827-aea6-e3e31053b248', 'b0a23688-080f-4367-9413-a4dc9d1528b5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:28 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:57:28 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:29 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:57:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Deleted volume successfully. Aug 24 09:57:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-902425b2-858d-471a-ade9-749cfda15ee6 tempest-ServersNegativeTestJSON-239521811 None] Lock "cinder-f37a2080-90e2-4097-9c2e-4ddcb2d672c3-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-6a5b37e0-15de-4cfa-803c-c83236a8389c req-8c88f2b0-e237-40b3-a019-edf29a691b55 tempest-AttachVolumeTestJSON-1788094156 None] Terminate volume connection completed successfully. Aug 24 09:57:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-6a5b37e0-15de-4cfa-803c-c83236a8389c req-8c88f2b0-e237-40b3-a019-edf29a691b55 tempest-AttachVolumeTestJSON-1788094156 None] Deleting attachment 438ed8a0-de24-49f1-acdc-f6ca31b24149. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:57:41 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=32,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:57:41 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=4 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Flow 'volume_create_manager' (3b45ffb6-1099-44fe-a6bc-d1fea26f0d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945acb3d-2138-441c-8d1a-644bfab18ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945acb3d-2138-441c-8d1a-644bfab18ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2142245141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c61d1ac6072454d8b911084a1190849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:45Z,use_quota=True,user_id='ed484fb279dd43949c0fd23af74f1e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7986c64-7a70-4fe1-ae5f-e425c00805cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7986c64-7a70-4fe1-ae5f-e425c00805cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a636604-d03e-4e80-bcdc-83261245474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a636604-d03e-4e80-bcdc-83261245474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2', 'volume_name': 'volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a68e8ff-72c7-4338-ba5f-01cc2a63298a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a68e8ff-72c7-4338-ba5f-01cc2a63298a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab48d74-bedc-43b6-a4df-cc9f7b2d3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Volume 9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2', 'volume_size': 1} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2142245141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c61d1ac6072454d8b911084a1190849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:45Z,use_quota=True,user_id='ed484fb279dd43949c0fd23af74f1e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Creating volume 9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:57:44 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:57:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:44 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 1073741824 Aug 24 09:57:44 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:45 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 1073741824" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:45 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 Aug 24 09:57:45 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:45 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab48d74-bedc-43b6-a4df-cc9f7b2d3762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8873a2e8-13c0-4436-acec-23ef8ce3ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:45 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Volume volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 (9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2): created successfully Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8873a2e8-13c0-4436-acec-23ef8ce3ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Flow 'volume_create_manager' (3b45ffb6-1099-44fe-a6bc-d1fea26f0d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-99d9984b-b998-4fbd-aa17-32db25aaed32 req-3d5ded7b-a58c-4e9f-a25c-056578280db0 tempest-VolumesSnapshotsTestJSON-1086480952 None] Created volume successfully. Aug 24 09:57:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Creating offline snapshot 3d621ab9-f22f-47ae-adbd-9fe2c201d40b of volume 9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 09:57:47 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a9c6e-e7b0-483f-8684-57a4b7f222d9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:57:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:47 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 Aug 24 09:57:47 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:48 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" returned: 0 in 0.616s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:48 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b 1G Aug 24 09:57:48 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Flow 'volume_create_manager' (1879a950-c665-44f6-8cc6-c20632b4ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754a988a-33d8-492d-a687-0104eed1039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754a988a-33d8-492d-a687-0104eed1039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1599623518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a0660f-0d46-4d90-a231-8df636353104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffb983e90dd4c2c952441add7cb67cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:48Z,use_quota=True,user_id='f14b6c23e0094f79969db53646849ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66decf7a-3e9b-4bc1-81a0-cc783eb89d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66decf7a-3e9b-4bc1-81a0-cc783eb89d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7ec13a-3e36-4dbf-8763-453aeae941bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7ec13a-3e36-4dbf-8763-453aeae941bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a0660f-0d46-4d90-a231-8df636353104', 'volume_name': 'volume-36a0660f-0d46-4d90-a231-8df636353104', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82993a49-5e7c-4511-8517-153450d4c56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82993a49-5e7c-4511-8517-153450d4c56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc8ab33-092d-41b8-a7fb-3dd14ea1c4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Volume 36a0660f-0d46-4d90-a231-8df636353104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a0660f-0d46-4d90-a231-8df636353104', 'volume_size': 1} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:48 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b 1G" returned: 0 in 0.462s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:48 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b Aug 24 09:57:48 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:48 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b" returned: 0 in 0.294s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:48 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b is being set with open permissions: ugo+rw Aug 24 09:57:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:48 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b Aug 24 09:57:48 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:49 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b" returned: 0 in 0.345s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:49 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info Aug 24 09:57:49 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:49 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:49 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info is being set with open permissions: ugo+rw Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:49 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info Aug 24 09:57:49 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:49 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.info" returned: 0 in 0.265s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1599623518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a0660f-0d46-4d90-a231-8df636353104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffb983e90dd4c2c952441add7cb67cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:48Z,use_quota=True,user_id='f14b6c23e0094f79969db53646849ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Creating volume 36a0660f-0d46-4d90-a231-8df636353104 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:57:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:57:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:49 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 1073741824 Aug 24 09:57:49 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-a86c315b-ef9a-41b7-814a-3f1837e7d850 req-4294556e-bd09-43dd-9862-cebbdf1c121e tempest-VolumesSnapshotsTestJSON-1086480952 None] Create snapshot completed successfully Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "cinder-3d621ab9-f22f-47ae-adbd-9fe2c201d40b-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-3d621ab9-f22f-47ae-adbd-9fe2c201d40b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "cinder-quobyte-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-quobyte-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "cinder-quobyte-3d621ab9-f22f-47ae-adbd-9fe2c201d40b" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-quobyte-3d621ab9-f22f-47ae-adbd-9fe2c201d40b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Deleting offline snapshot 3d621ab9-f22f-47ae-adbd-9fe2c201d40b of volume 9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] snapshot_file for this snap is: volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28a2f5d-d13e-4f36-a244-96187ec79623]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:50 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 1073741824" returned: 0 in 0.621s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:50 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b Aug 24 09:57:50 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:50 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 Aug 24 09:57:50 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:50 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104" returned: 0 in 0.261s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:50 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc8ab33-092d-41b8-a7fb-3dd14ea1c4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a0660f-0d46-4d90-a231-8df636353104', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54308c3f-38d3-49cc-b7d6-de8673bb986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b" returned: 0 in 0.435s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 09:57:50 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Volume volume-36a0660f-0d46-4d90-a231-8df636353104 (36a0660f-0d46-4d90-a231-8df636353104): created successfully Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54308c3f-38d3-49cc-b7d6-de8673bb986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Flow 'volume_create_manager' (1879a950-c665-44f6-8cc6-c20632b4ba40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[04214bf2-1bb3-429c-86a0-f45ee2433a02]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:57:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4bd16eef-f33a-460f-89db-cc64418a461c tempest-AttachVolumeNegativeTest-44824851 None] Created volume successfully. Aug 24 09:57:50 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 Aug 24 09:57:50 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:51 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" returned: 0 in 0.391s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:51 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b Aug 24 09:57:51 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:51 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b" returned: 0 in 0.409s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:51 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b Aug 24 09:57:51 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:51 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2.3d621ab9-f22f-47ae-adbd-9fe2c201d40b" returned: 0 in 0.356s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-quobyte-3d621ab9-f22f-47ae-adbd-9fe2c201d40b" released by "_delete_snapshot" :: held 1.723s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-quobyte-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" released by "delete_snapshot" :: held 1.762s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:52 devstack cinder-volume[94039]: WARNING cinder.quota [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.quota [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Created reservations ['07d762ad-3687-4432-80e5-124bc65e71b5', '06bd7fe3-0961-41df-bc2d-b23962f6568f', '6daaf289-483d-4828-9249-05b8ede1e6cf', 'c1184098-5313-4ab9-9eb1-8f38d8033e67'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-48494dfd-75c2-4d1a-b35e-9dee85a9a4e5 req-93317923-6f9f-4b1f-b406-99671293577d tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-48494dfd-75c2-4d1a-b35e-9dee85a9a4e5 req-93317923-6f9f-4b1f-b406-99671293577d tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Delete snapshot completed successfully. Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-48494dfd-75c2-4d1a-b35e-9dee85a9a4e5 req-93317923-6f9f-4b1f-b406-99671293577d tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-16056155-7986-4795-92ac-c3492e25822a req-8c8e5f2c-dc44-440b-b312-0e7fa0ccb638 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-3d621ab9-f22f-47ae-adbd-9fe2c201d40b-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-48494dfd-75c2-4d1a-b35e-9dee85a9a4e5 req-93317923-6f9f-4b1f-b406-99671293577d tempest-AttachVolumeNegativeTest-44824851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-36a0660f-0d46-4d90-a231-8df636353104', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2db4715c-cd88-4758-a844-39c7c1ddf4e5', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:57:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-48494dfd-75c2-4d1a-b35e-9dee85a9a4e5 req-93317923-6f9f-4b1f-b406-99671293577d tempest-AttachVolumeNegativeTest-44824851 None] attachment_update completed successfully. Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "cinder-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "cinder-quobyte-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-quobyte-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[59410e57-c4cf-4b87-82aa-555fbb7dd7f2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:57:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:52 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 Aug 24 09:57:52 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:53 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" returned: 0 in 0.415s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:53 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2 Aug 24 09:57:53 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:53 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" returned: 0 in 0.300s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-quobyte-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2" released by "delete_volume" :: held 0.794s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG cinder.quota [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Created reservations ['80570347-69db-4cd7-a794-37f98d7b27d8', 'f6b83b66-07cf-4111-91fc-2326096749c5', '87fc9a64-3866-4a15-974f-72e9335b7e1e', 'afb10e90-a8f9-4af8-bbfe-9d08584d00be'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:53 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:57:53 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:53 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG cinder.manager [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:57:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Deleted volume successfully. Aug 24 09:57:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-cf93bb10-83f6-43f5-9f37-e2a6b38253d9 req-c2c2bf13-6e98-4785-9784-f71b531e2ba4 tempest-VolumesSnapshotsTestJSON-1086480952 None] Lock "cinder-9195fb5b-e4cf-47b6-ab9e-a6aac3cf13e2-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:57:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-1b76422c-3437-47f6-bd29-7251f935eeb5 req-40b66b56-9ee2-441d-8e8b-7824bcfdf4cf tempest-ServerActionsTestOtherA-873819248 None] Terminate volume connection completed successfully. Aug 24 09:57:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-1b76422c-3437-47f6-bd29-7251f935eeb5 req-40b66b56-9ee2-441d-8e8b-7824bcfdf4cf tempest-ServerActionsTestOtherA-873819248 None] Deleting attachment 142910db-c7d3-4aee-8b21-e085fd6f7092. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Flow 'volume_create_manager' (2de22682-96df-44d7-97f2-bf8a5d04c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a463406-347e-47b2-8bd6-afcc7493b3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a463406-347e-47b2-8bd6-afcc7493b3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-297371864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49530a11-10b0-4527-b043-38dbe982cc9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50e4c01371884537b4a1e8afffd74495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:59Z,use_quota=True,user_id='d385acaed3d34eb9a0d98e4190257ced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9e8fb3-c170-4842-a17e-7f2fe3064305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9e8fb3-c170-4842-a17e-7f2fe3064305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098ee21a-e095-46a6-9367-9308853978c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098ee21a-e095-46a6-9367-9308853978c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49530a11-10b0-4527-b043-38dbe982cc9a', 'volume_name': 'volume-49530a11-10b0-4527-b043-38dbe982cc9a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c198a1e-37df-40a8-83c5-033957164929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c198a1e-37df-40a8-83c5-033957164929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2175f3-f477-4e0d-b57d-83a1ee3900fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Volume 49530a11-10b0-4527-b043-38dbe982cc9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49530a11-10b0-4527-b043-38dbe982cc9a', 'volume_size': 1} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-297371864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49530a11-10b0-4527-b043-38dbe982cc9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='50e4c01371884537b4a1e8afffd74495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:57:59Z,use_quota=True,user_id='d385acaed3d34eb9a0d98e4190257ced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Creating volume 49530a11-10b0-4527-b043-38dbe982cc9a {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:57:58 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:57:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:58 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a 1073741824 Aug 24 09:57:58 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:59 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a 1073741824" returned: 0 in 0.600s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:57:59 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a Aug 24 09:57:59 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:57:59 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2175f3-f477-4e0d-b57d-83a1ee3900fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49530a11-10b0-4527-b043-38dbe982cc9a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6ea867-f83d-45be-af14-30733910cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:57:59 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Volume volume-49530a11-10b0-4527-b043-38dbe982cc9a (49530a11-10b0-4527-b043-38dbe982cc9a): created successfully Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6ea867-f83d-45be-af14-30733910cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:57:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Flow 'volume_create_manager' (2de22682-96df-44d7-97f2-bf8a5d04c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-9a61a722-a5f0-4a2f-a181-c06d4fcd9879 req-acc019f9-510b-476c-b028-09841fdac4b7 tempest-VolumesGetTestJSON-593003356 None] Created volume successfully. Aug 24 09:58:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Acquiring lock "cinder-49530a11-10b0-4527-b043-38dbe982cc9a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:58:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Lock "cinder-49530a11-10b0-4527-b043-38dbe982cc9a-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:58:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Acquiring lock "cinder-quobyte-49530a11-10b0-4527-b043-38dbe982cc9a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:58:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Lock "cinder-quobyte-49530a11-10b0-4527-b043-38dbe982cc9a" acquired by "delete_volume" :: waited 0.045s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:58:01 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecfcdf3-4fb2-439f-9f94-7db0075acfdb]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:01 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a Aug 24 09:58:01 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Flow 'volume_create_manager' (9f06786c-de38-4227-b97a-9603b4a6435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db35049f-b381-44f2-9724-c64daae9cd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:02 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db35049f-b381-44f2-9724-c64daae9cd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1798153144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566535e0a20940b7b78811ec1c29e9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:02Z,use_quota=True,user_id='62dd657679f64536a352a14123be0f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:02 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a Aug 24 09:58:02 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bfb912-3cf4-43b0-90e8-7a81c272b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bfb912-3cf4-43b0-90e8-7a81c272b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2ead75-1aca-40a5-ae5b-2c39a1a4c7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 09:58:02 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-49530a11-10b0-4527-b043-38dbe982cc9a" returned: 0 in 0.328s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Lock "cinder-quobyte-49530a11-10b0-4527-b043-38dbe982cc9a" released by "delete_volume" :: held 0.988s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.quota [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Created reservations ['6de0bfd5-0fb7-43df-ab13-0efa2e3b5b95', '415c14cb-98dd-4538-bc8c-f3b3434ec14a', 'cd6c15bb-932c-46c1-b767-5da1f829179a', 'fe4f11d7-a020-4864-8d1e-cb0770a26edb'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:02 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:58:02 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2ead75-1aca-40a5-ae5b-2c39a1a4c7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f', 'volume_name': 'volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44977026-0440-4b51-96ad-5a27982426b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44977026-0440-4b51-96ad-5a27982426b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cb0e91-d076-45f1-b220-f5aa1649ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Volume 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 24 09:58:02 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Trying to clone 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 09:58:03 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.339s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:03 devstack cinder-volume[94039]: DEBUG cinder.manager [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:58:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Deleted volume successfully. Aug 24 09:58:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-bd47c188-3d53-4ba3-b97c-ab624f1fa505 req-24befc8e-9397-4ea0-acee-56f3ead3c274 tempest-VolumesGetTestJSON-593003356 None] Lock "cinder-49530a11-10b0-4527-b043-38dbe982cc9a-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:58:03 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 09:58:03 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Image download 20.69 MB at 20.69 MB/s Aug 24 09:58:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c6f57-9b56-4e9b-ae92-8e87e3cb40d9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:03 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD Aug 24 09:58:03 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:04 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 is fetched for user 62dd657679f64536a352a14123be0f8e. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93108df-24c4-4e2a-a2ca-53f48c313b6f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:04 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD Aug 24 09:58:04 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:04 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1798153144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566535e0a20940b7b78811ec1c29e9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:02Z,use_quota=True,user_id='62dd657679f64536a352a14123be0f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Creating volume 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:58:05 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:58:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:05 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f 1073741824 Aug 24 09:58:05 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:05 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f 1073741824" returned: 0 in 0.941s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:06 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f Aug 24 09:58:06 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:06 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" returned: 0 in 0.416s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Attempting download of 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba029ed3-1826-4ce9-a5cc-9b49d03a7dac]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:06 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp Aug 24 09:58:06 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:07 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp" returned: 0 in 0.499s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:07 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp Aug 24 09:58:07 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:07 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp" returned: 1 in 0.720s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_jmvzkxdp' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 09:58:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e15dc4c-02d3-47dd-95d4-fc5c0762b128]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:08 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD Aug 24 09:58:08 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:08 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD" returned: 0 in 0.600s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:08 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] 75b0df00-ae63-45cf-a244-f0a90610f6d1 was qcow2, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 09:58:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:08 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f Aug 24 09:58:08 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:11 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" returned: 0 in 3.292s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:11 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_65wzxbl3devstack@QuobyteHD, size 112.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 09:58:11 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Converted 112.00 MB image at 34.01 MB/s Aug 24 09:58:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:11 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f 1G Aug 24 09:58:11 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0cb14f7b-52b9-4a34-bad1-153a43c8a958 tempest-GroupSnapshotsV319Test-1320205697 None] Group tempest-GroupSnapshotsV319Test-Group-924273516: creating Aug 24 09:58:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0cb14f7b-52b9-4a34-bad1-153a43c8a958 tempest-GroupSnapshotsV319Test-1320205697 None] Group tempest-GroupSnapshotsV319Test-Group-924273516: created successfully Aug 24 09:58:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0cb14f7b-52b9-4a34-bad1-153a43c8a958 tempest-GroupSnapshotsV319Test-1320205697 None] Create group completed successfully. Aug 24 09:58:12 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f 1G" returned: 0 in 0.836s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Downloaded image 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 for user 62dd657679f64536a352a14123be0f8e is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Marking volume 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Copying metadata from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 to 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Creating volume glance metadata for volume 51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f backed by image 75b0df00-ae63-45cf-a244-f0a90610f6d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cb0e91-d076-45f1-b220-f5aa1649ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efbb8cc-d9b8-4b1a-ba66-b4c0630b2ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:12 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Volume volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f (51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f): created successfully Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efbb8cc-d9b8-4b1a-ba66-b4c0630b2ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Flow 'volume_create_manager' (9f06786c-de38-4227-b97a-9603b4a6435c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fd7f2894-6362-4cc5-b473-c9f5cab9e9c7 tempest-ServerActionsTestOtherA-873819248 None] Created volume successfully. Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Flow 'volume_create_manager' (4199baa0-9e08-4454-9290-244cbcec7f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01993cf-bf6d-4b7c-abc7-bb8181345986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01993cf-bf6d-4b7c-abc7-bb8181345986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2076320580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f74c51f-5904-4246-876b-28934185655e,host='devstack@QuobyteHD#QuobyteHD',id=0eb7ec39-e93c-44a4-80e4-d5e80efc44c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0509e5485a5f462087bb44a60707b113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:14Z,use_quota=True,user_id='4b0c8dec5060441f99b0d3119263584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b034d85-c877-4df2-bc3d-5c0d6c7bf08c),volume_type_id=5b034d85-c877-4df2-bc3d-5c0d6c7bf08c)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fa6e00-86aa-4ac7-9bb8-76c91e8aa387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fa6e00-86aa-4ac7-9bb8-76c91e8aa387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ca409a-07b7-491f-9b4c-94c4901f8bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ca409a-07b7-491f-9b4c-94c4901f8bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb7ec39-e93c-44a4-80e4-d5e80efc44c2', 'volume_name': 'volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ded24b-fe9d-4b9b-8ea6-7a1875822d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ded24b-fe9d-4b9b-8ea6-7a1875822d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0343f4e-4de3-43c2-a27f-9973d60ae290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:14 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Volume 0eb7ec39-e93c-44a4-80e4-d5e80efc44c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2', 'volume_size': 1} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0f74c51f-5904-4246-876b-28934185655e,created_at=2026-08-24T07:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2076320580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0f74c51f-5904-4246-876b-28934185655e,host='devstack@QuobyteHD#QuobyteHD',id=0eb7ec39-e93c-44a4-80e4-d5e80efc44c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0509e5485a5f462087bb44a60707b113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:14Z,use_quota=True,user_id='4b0c8dec5060441f99b0d3119263584e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b034d85-c877-4df2-bc3d-5c0d6c7bf08c),volume_type_id=5b034d85-c877-4df2-bc3d-5c0d6c7bf08c)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Creating volume 0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:58:14 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:58:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:14 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 1073741824 Aug 24 09:58:14 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:15 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 1073741824" returned: 0 in 0.701s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:15 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 Aug 24 09:58:15 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:15 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" returned: 0 in 0.515s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0343f4e-4de3-43c2-a27f-9973d60ae290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2b82ee-ff47-4cc9-b8c1-d96b2390ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:15 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Volume volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 (0eb7ec39-e93c-44a4-80e4-d5e80efc44c2): created successfully Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2b82ee-ff47-4cc9-b8c1-d96b2390ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Flow 'volume_create_manager' (4199baa0-9e08-4454-9290-244cbcec7f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-635f3085-197b-4e6f-bc30-b4acc1790454 tempest-GroupSnapshotsV319Test-1320205697 None] Created volume successfully. Aug 24 09:58:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] GroupSnapshot e8d63cef-62c3-4c5b-8e70-bc5559d88270: creating. Aug 24 09:58:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Group snapshot e8d63cef-62c3-4c5b-8e70-bc5559d88270: creating. {{(pid=94039) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 24 09:58:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Creating offline snapshot e2ef2e4e-b624-45f9-8d87-1faae9320190 of volume 0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 09:58:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3d7c3-162c-43bc-ba6a-b5d431055fdf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:17 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 Aug 24 09:58:17 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:18 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" returned: 0 in 0.656s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:18 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 1G Aug 24 09:58:18 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-6781f08f-c75f-46c3-9dd4-981de721107f req-601c601d-b57e-4aed-b45f-fb792543b434 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:19 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 1G" returned: 0 in 0.944s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:19 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 Aug 24 09:58:19 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:19 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190" returned: 0 in 0.756s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:19 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 is being set with open permissions: ugo+rw: NotImplementedError Aug 24 09:58:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:20 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 Aug 24 09:58:20 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:20 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190" returned: 0 in 0.433s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:20 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info Aug 24 09:58:20 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:20 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info" returned: 0 in 0.301s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:20 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info is being set with open permissions: ugo+rw: NotImplementedError Aug 24 09:58:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:20 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info Aug 24 09:58:20 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:21 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.info" returned: 0 in 0.320s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-6781f08f-c75f-46c3-9dd4-981de721107f req-601c601d-b57e-4aed-b45f-fb792543b434 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.584s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-6781f08f-c75f-46c3-9dd4-981de721107f req-601c601d-b57e-4aed-b45f-fb792543b434 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-6781f08f-c75f-46c3-9dd4-981de721107f req-601c601d-b57e-4aed-b45f-fb792543b434 tempest-ServerActionsTestOtherA-873819248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fbbfbef-42b3-4094-8331-9c058681b426', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:58:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c53a0b6a-d028-475b-91c3-59713407ef18 tempest-GroupSnapshotsV319Test-1320205697 None] group_snapshot e8d63cef-62c3-4c5b-8e70-bc5559d88270: created successfully Aug 24 09:58:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-6781f08f-c75f-46c3-9dd4-981de721107f req-601c601d-b57e-4aed-b45f-fb792543b434 tempest-ServerActionsTestOtherA-873819248 None] attachment_update completed successfully. Aug 24 09:58:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] group_snapshot e8d63cef-62c3-4c5b-8e70-bc5559d88270: deleting Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] group_snapshot e8d63cef-62c3-4c5b-8e70-bc5559d88270: deleting {{(pid=94039) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "cinder-quobyte-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Lock "cinder-quobyte-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "cinder-quobyte-e2ef2e4e-b624-45f9-8d87-1faae9320190" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Lock "cinder-quobyte-e2ef2e4e-b624-45f9-8d87-1faae9320190" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Deleting offline snapshot e2ef2e4e-b624-45f9-8d87-1faae9320190 of volume 0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] snapshot_file for this snap is: volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b45713-d1fc-4501-868a-6773fa788406]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:22 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 Aug 24 09:58:22 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:23 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190" returned: 0 in 0.793s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 09:58:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[131329f1-9c78-4301-9869-ff0c49abd1d0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:23 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 Aug 24 09:58:23 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:24 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" returned: 0 in 0.743s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:24 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 Aug 24 09:58:24 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:24 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190" returned: 0 in 0.502s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:24 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190 Aug 24 09:58:24 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:25 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2.e2ef2e4e-b624-45f9-8d87-1faae9320190" returned: 0 in 0.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Lock "cinder-quobyte-e2ef2e4e-b624-45f9-8d87-1faae9320190" released by "_delete_snapshot" :: held 2.592s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:58:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Lock "cinder-quobyte-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" released by "delete_snapshot" :: held 2.630s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:58:25 devstack cinder-volume[94039]: WARNING cinder.quota [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-118861866 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-118861866, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:58:25 devstack cinder-volume[94039]: WARNING cinder.quota [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-118861866 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-118861866, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:58:25 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] Created reservations ['57817eb4-29b0-4f9b-81ac-4b7ea0429c89', '65485c96-e53c-4e12-a945-ff0590777379', '07ae4082-a035-4d06-b949-1b1ee48b535c', '356a7c9c-14fd-4b70-875f-5c01baab3d28'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:58:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-41c70deb-0184-4b6f-829d-baae13e1507f tempest-GroupSnapshotsV319Test-1320205697 None] group_snapshot e8d63cef-62c3-4c5b-8e70-bc5559d88270: deleted successfully Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:26 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:58:26 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:26 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.536s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:58:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:58:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "cinder-quobyte-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:58:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Lock "cinder-quobyte-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" acquired by "delete_volume" :: waited 0.072s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:58:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24610b-5db7-4c54-8405-016596e56786]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:27 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 Aug 24 09:58:27 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:28 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" returned: 0 in 0.731s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:28 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2 Aug 24 09:58:28 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:28 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" returned: 0 in 0.747s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Lock "cinder-quobyte-0eb7ec39-e93c-44a4-80e4-d5e80efc44c2" released by "delete_volume" :: held 1.669s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:58:28 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Created reservations ['1f9c830f-530e-4282-a02c-132bf712ea07'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:58:29 devstack cinder-volume[94039]: WARNING cinder.quota [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-118861866 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-118861866, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Created reservations ['eee3caf0-0d08-4642-a845-4427b1ad125e', 'e9d511ab-85da-49ee-bb3a-5ef134346a96', '1cc379c5-fe55-40ad-ab2c-746b617994dd', '11265d9f-97a7-42fc-8c00-181f30bc2e9e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:29 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:58:29 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:29 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.390s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:58:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-15d43602-e218-45bc-85f6-88ac54710d0c tempest-GroupSnapshotsV319Test-1320205697 None] Delete group completed successfully. Aug 24 09:58:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=73,cinder:UPDATE=56,cinder:INSERT=21,cinder:DELETE=4 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:58:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=73,cinder:UPDATE=69,cinder:INSERT=20,cinder:DELETE=4 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:58:42 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-49f870cb-4504-4911-b06c-f2133ef40af9 req-36e5e3a1-6c1e-484b-a5c3-886509a90a81 tempest-AttachVolumeNegativeTest-44824851 None] Terminate volume connection completed successfully. Aug 24 09:58:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-49f870cb-4504-4911-b06c-f2133ef40af9 req-36e5e3a1-6c1e-484b-a5c3-886509a90a81 tempest-AttachVolumeNegativeTest-44824851 None] Deleting attachment 2db4715c-cd88-4758-a844-39c7c1ddf4e5. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:58:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-b7c6c1f2-5595-49b2-a70e-b2e99889f4e7 tempest-ServerActionsTestOtherA-873819248 None] Terminate volume connection completed successfully. Aug 24 09:58:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-b7c6c1f2-5595-49b2-a70e-b2e99889f4e7 tempest-ServerActionsTestOtherA-873819248 None] Deleting attachment 9fbbfbef-42b3-4094-8331-9c058681b426. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:58:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2d6dfed3-7c3f-4da6-a769-e5c941a4889b tempest-GroupsV314Test-1433572018 None] Group tempest-GroupsV314Test-Group-393445517: creating Aug 24 09:58:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2d6dfed3-7c3f-4da6-a769-e5c941a4889b tempest-GroupsV314Test-1433572018 None] Group tempest-GroupsV314Test-Group-393445517: created successfully Aug 24 09:58:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2d6dfed3-7c3f-4da6-a769-e5c941a4889b tempest-GroupsV314Test-1433572018 None] Create group completed successfully. Aug 24 09:58:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-95cfe878-7f92-4fe8-bfdc-7d7f3ecb59ae tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-95cfe878-7f92-4fe8-bfdc-7d7f3ecb59ae tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Flow 'volume_create_manager' (e626be1d-854f-4394-94c2-20bddd951379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3510a2-7d59-4b3c-89e2-6456a6039c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3510a2-7d59-4b3c-89e2-6456a6039c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555957878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dad23f77-6d5f-4c77-8983-e9466091689c,host='devstack@QuobyteHD#QuobyteHD',id=30eb79c9-5411-4fc8-bf8d-b69965b72c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffeb142c15ee4482b96d215609d19fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:46Z,use_quota=True,user_id='97f097e6971640588f0c6ea649f958b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1abec4d7-3ce6-4765-b1e4-0ba8eb48bd42),volume_type_id=1abec4d7-3ce6-4765-b1e4-0ba8eb48bd42)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2dc576-6cf7-4422-83b7-e695c37ba8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2dc576-6cf7-4422-83b7-e695c37ba8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aba5ac1-d37a-43de-92c3-c0c29f2be49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aba5ac1-d37a-43de-92c3-c0c29f2be49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30eb79c9-5411-4fc8-bf8d-b69965b72c18', 'volume_name': 'volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d30746b-a77b-4ea9-b588-a5803b19b37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d30746b-a77b-4ea9-b588-a5803b19b37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0791f835-34c5-4d11-beb5-ba5dec6bd321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:46 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Volume 30eb79c9-5411-4fc8-bf8d-b69965b72c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18', 'volume_size': 1} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-95cfe878-7f92-4fe8-bfdc-7d7f3ecb59ae tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.104s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dad23f77-6d5f-4c77-8983-e9466091689c,created_at=2026-08-24T07:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-555957878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dad23f77-6d5f-4c77-8983-e9466091689c,host='devstack@QuobyteHD#QuobyteHD',id=30eb79c9-5411-4fc8-bf8d-b69965b72c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffeb142c15ee4482b96d215609d19fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:46Z,use_quota=True,user_id='97f097e6971640588f0c6ea649f958b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1abec4d7-3ce6-4765-b1e4-0ba8eb48bd42),volume_type_id=1abec4d7-3ce6-4765-b1e4-0ba8eb48bd42)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Creating volume 30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:58:46 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:46 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 1073741824 Aug 24 09:58:46 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-95cfe878-7f92-4fe8-bfdc-7d7f3ecb59ae tempest-ServerActionsTestOtherA-873819248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85c6e4a2-3b4e-4638-bb33-b14726c6517d', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:58:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-f9bc517d-05f8-41da-aa51-14ac29c443a4 req-95cfe878-7f92-4fe8-bfdc-7d7f3ecb59ae tempest-ServerActionsTestOtherA-873819248 None] attachment_update completed successfully. Aug 24 09:58:46 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 1073741824" returned: 0 in 0.515s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:46 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 Aug 24 09:58:46 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:47 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18" returned: 0 in 0.480s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0791f835-34c5-4d11-beb5-ba5dec6bd321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7816e43-c48e-4681-a4c0-f49d323cea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Volume volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 (30eb79c9-5411-4fc8-bf8d-b69965b72c18): created successfully Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7816e43-c48e-4681-a4c0-f49d323cea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Flow 'volume_create_manager' (e626be1d-854f-4394-94c2-20bddd951379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:47 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-256a740d-98b8-41bf-b85e-0b77fcbffb23 tempest-GroupsV314Test-1433572018 None] Created volume successfully. Aug 24 09:58:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Cloning volume 30eb79c9-5411-4fc8-bf8d-b69965b72c18 to volume 9f1a0d40-848b-4248-9fb4-6a609d97eef0 Aug 24 09:58:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Creating offline snapshot 9334f4e4-76f4-4068-aec1-3e53a9c30ba0 of volume 30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 09:58:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c879572-0e38-42ff-b36b-24e5392c8084]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:49 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 Aug 24 09:58:49 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:50 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18" returned: 0 in 0.742s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:50 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 1G Aug 24 09:58:50 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:50 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 1G" returned: 0 in 0.580s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:50 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 Aug 24 09:58:50 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:51 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0" returned: 0 in 0.383s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:51 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 is being set with open permissions: ugo+rw: NotImplementedError Aug 24 09:58:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:51 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 Aug 24 09:58:51 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:51 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0" returned: 0 in 0.460s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:51 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info Aug 24 09:58:51 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:52 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info" returned: 0 in 0.435s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:52 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info is being set with open permissions: ugo+rw: NotImplementedError Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:52 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info Aug 24 09:58:52 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:52 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.info" returned: 0 in 0.375s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Acquiring lock "cinder-quobyte-9f1a0d40-848b-4248-9fb4-6a609d97eef0" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-9f1a0d40-848b-4248-9fb4-6a609d97eef0" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] snapshot: 9334f4e4-76f4-4068-aec1-3e53a9c30ba0, volume: 9f1a0d40-848b-4248-9fb4-6a609d97eef0, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aece9b-d212-4320-a842-614f6861971a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:52 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 Aug 24 09:58:52 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:53 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0" returned: 0 in 0.769s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 09:58:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04973c6-cda7-45b8-88c1-7e40c38715fc]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:58:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:53 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 Aug 24 09:58:53 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Flow 'volume_create_manager' (222d9fc0-a09d-4810-b5aa-8e747b0ce512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a458a473-3f47-4a5f-8bbc-30f662395e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a458a473-3f47-4a5f-8bbc-30f662395e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-528703698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c000cea4804977b21e80c48c1070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:54Z,use_quota=True,user_id='0b40e9a77a2d421894ab94b7c9d64070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742321d0-97fa-4a12-b04a-be918f3ad9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742321d0-97fa-4a12-b04a-be918f3ad9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d35f1a4-8f3b-4626-8f0d-5bf9dd5b7f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d35f1a4-8f3b-4626-8f0d-5bf9dd5b7f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1', 'volume_name': 'volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3271c39c-0a67-407d-bbf9-f33108a150f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3271c39c-0a67-407d-bbf9-f33108a150f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9832fd-76a1-42f5-bf7a-12c410b7c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:58:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Volume f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1', 'volume_size': 1} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:58:54 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18" returned: 0 in 0.926s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 09:58:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:58:54 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 Aug 24 09:58:54 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:01 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0" returned: 0 in 7.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18, size 1024.00 MB, duration 7.29 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 09:59:01 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Converted 1024.00 MB image at 140.48 MB/s Aug 24 09:59:01 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 is being set with open permissions: ugo+rw: NotImplementedError Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:01 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 Aug 24 09:59:01 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:01 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0" returned: 0 in 0.287s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-9f1a0d40-848b-4248-9fb4-6a609d97eef0" released by "_copy_volume_from_snapshot" :: held 9.454s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Acquiring lock "cinder-quobyte-9334f4e4-76f4-4068-aec1-3e53a9c30ba0" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-9334f4e4-76f4-4068-aec1-3e53a9c30ba0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Deleting offline snapshot 9334f4e4-76f4-4068-aec1-3e53a9c30ba0 of volume 30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] snapshot_file for this snap is: volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa483c8-79c9-447e-abac-774c91c769a4]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:02 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 Aug 24 09:59:02 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:02 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0" returned: 0 in 0.506s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 09:59:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33bcfca-f807-4a08-ac4c-99adf1f95eca]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:02 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 Aug 24 09:59:02 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:03 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18" returned: 0 in 0.672s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:03 devstack sudo[101073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 Aug 24 09:59:03 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:03 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0" returned: 0 in 0.736s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:04 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0 Aug 24 09:59:04 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=2 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:59:04 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18.9334f4e4-76f4-4068-aec1-3e53a9c30ba0" returned: 0 in 0.683s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-9334f4e4-76f4-4068-aec1-3e53a9c30ba0" released by "_delete_snapshot" :: held 2.769s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.509s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.657s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-528703698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c000cea4804977b21e80c48c1070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:58:54Z,use_quota=True,user_id='0b40e9a77a2d421894ab94b7c9d64070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Creating volume f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:04 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:04 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 1073741824 Aug 24 09:59:04 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-32c6cf69-9e59-45ab-b33d-d6c7ad497ea3 tempest-GroupsV314Test-1433572018 None] Create group from source-group-dad23f77-6d5f-4c77-8983-e9466091689c completed successfully. Aug 24 09:59:05 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 1073741824" returned: 0 in 0.703s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:05 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 Aug 24 09:59:05 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:05 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1" returned: 0 in 0.326s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9832fd-76a1-42f5-bf7a-12c410b7c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca54da0-4e81-43cb-b739-734cc5a8108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Volume volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 (f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1): created successfully Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca54da0-4e81-43cb-b739-734cc5a8108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Flow 'volume_create_manager' (222d9fc0-a09d-4810-b5aa-8e747b0ce512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c7e795bc-e68e-4baf-abc8-c3e2ade24c6c tempest-AttachVolumeTestJSON-1788094156 None] Created volume successfully. Aug 24 09:59:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Acquiring lock "cinder-quobyte-9f1a0d40-848b-4248-9fb4-6a609d97eef0" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-9f1a0d40-848b-4248-9fb4-6a609d97eef0" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0936b9f-8997-4f0d-a4ba-8b2a51fb4408]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:06 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 Aug 24 09:59:06 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:06 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0" returned: 0 in 0.433s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:06 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0 Aug 24 09:59:06 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:07 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9f1a0d40-848b-4248-9fb4-6a609d97eef0" returned: 0 in 0.540s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-9f1a0d40-848b-4248-9fb4-6a609d97eef0" released by "delete_volume" :: held 1.065s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Created reservations ['2a121355-d687-4f3f-bedc-87a17a7cb8d7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:07 devstack cinder-volume[94039]: WARNING cinder.quota [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1415553731 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1415553731, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:59:07 devstack cinder-volume[94039]: WARNING cinder.quota [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1415553731 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1415553731, it is now deprecated. Please use the default quota class for default quota. Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Created reservations ['1705b2c4-25a6-4ec2-b7a5-d6776d88582e', 'f3bae0c2-7aa2-409f-b286-b512ec182e0c', 'a67805b3-c69e-4421-a0ef-2c95a6ef046c', '65bb2ecb-25e5-441d-a4bf-03c22142cb27'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:07 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:07 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:08 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.412s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:08 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1c1f9779-1d1d-4518-8c68-e31646441395 tempest-GroupsV314Test-1433572018 None] Delete group completed successfully. Aug 24 09:59:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-4d197914-dacd-4def-ae40-27386c66cd93 req-b95951db-5479-4bcd-a1d2-d515ebfecbd4 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-4d197914-dacd-4def-ae40-27386c66cd93 req-b95951db-5479-4bcd-a1d2-d515ebfecbd4 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-4d197914-dacd-4def-ae40-27386c66cd93 req-b95951db-5479-4bcd-a1d2-d515ebfecbd4 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-4d197914-dacd-4def-ae40-27386c66cd93 req-b95951db-5479-4bcd-a1d2-d515ebfecbd4 tempest-AttachVolumeTestJSON-1788094156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a52ff07a-788f-4c18-aedc-505ad4059a2d', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:59:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-4d197914-dacd-4def-ae40-27386c66cd93 req-b95951db-5479-4bcd-a1d2-d515ebfecbd4 tempest-AttachVolumeTestJSON-1788094156 None] attachment_update completed successfully. Aug 24 09:59:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Acquiring lock "cinder-quobyte-30eb79c9-5411-4fc8-bf8d-b69965b72c18" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-30eb79c9-5411-4fc8-bf8d-b69965b72c18" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e29c5ae-9c2d-4a4c-a7e6-c18d038b6ea5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:09 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 Aug 24 09:59:09 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:10 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18" returned: 0 in 0.794s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:10 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18 Aug 24 09:59:10 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:10 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-30eb79c9-5411-4fc8-bf8d-b69965b72c18" returned: 0 in 0.405s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Lock "cinder-quobyte-30eb79c9-5411-4fc8-bf8d-b69965b72c18" released by "delete_volume" :: held 1.393s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Created reservations ['557baeaf-5848-4996-bf7f-f36583caad9e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Created reservations ['9c046122-b94e-40a1-b862-d5cd901ce042', '488d5461-ef29-4bf5-9fe3-204a4870bc28', 'b921c656-fadf-47d2-b8a8-6ddd0ea95978', '236e5012-f6d0-4d3c-898e-7ec9754248b8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:11 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:11 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Flow 'volume_create_manager' (e9b13f48-b7b1-48df-9b7e-4a25437be207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b5ed69-caad-401e-8149-0b353f7a7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b5ed69-caad-401e-8149-0b353f7a7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-847945311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db6b773-8743-49c7-b981-24ba6732656c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c000cea4804977b21e80c48c1070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:12Z,use_quota=True,user_id='0b40e9a77a2d421894ab94b7c9d64070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeebeb7-ba9f-44e6-8de2-240b0802773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eeebeb7-ba9f-44e6-8de2-240b0802773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5efef5-8ca4-4eff-b0dc-870354613090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a5efef5-8ca4-4eff-b0dc-870354613090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db6b773-8743-49c7-b981-24ba6732656c', 'volume_name': 'volume-0db6b773-8743-49c7-b981-24ba6732656c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4719d40-5b28-498e-b931-df8bdac04c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4719d40-5b28-498e-b931-df8bdac04c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d32eca-5623-412f-a040-44d0b57eeabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Volume 0db6b773-8743-49c7-b981-24ba6732656c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db6b773-8743-49c7-b981-24ba6732656c', 'volume_size': 1} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-847945311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db6b773-8743-49c7-b981-24ba6732656c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c000cea4804977b21e80c48c1070e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:12Z,use_quota=True,user_id='0b40e9a77a2d421894ab94b7c9d64070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Creating volume 0db6b773-8743-49c7-b981-24ba6732656c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:11 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:11 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.356s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:11 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8358df50-1e4b-4687-8b38-f912fdf2987b tempest-GroupsV314Test-1433572018 None] Delete group completed successfully. Aug 24 09:59:11 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c 1073741824 Aug 24 09:59:11 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:12 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c 1073741824" returned: 0 in 0.588s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:12 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c Aug 24 09:59:12 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:12 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c" returned: 0 in 0.288s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d32eca-5623-412f-a040-44d0b57eeabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db6b773-8743-49c7-b981-24ba6732656c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f608846f-628a-4778-a186-71e3049e4e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:12 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Volume volume-0db6b773-8743-49c7-b981-24ba6732656c (0db6b773-8743-49c7-b981-24ba6732656c): created successfully Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f608846f-628a-4778-a186-71e3049e4e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Flow 'volume_create_manager' (e9b13f48-b7b1-48df-9b7e-4a25437be207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-62c51f9f-ec9a-45d3-af6f-5526faf6628f tempest-AttachVolumeTestJSON-1788094156 None] Created volume successfully. Aug 24 09:59:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-d07ccd6f-ff21-4ff4-9eea-7cc9b9cb1e89 req-9996f894-6259-4894-94cf-7d2f115c6788 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-d07ccd6f-ff21-4ff4-9eea-7cc9b9cb1e89 req-9996f894-6259-4894-94cf-7d2f115c6788 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-d07ccd6f-ff21-4ff4-9eea-7cc9b9cb1e89 req-9996f894-6259-4894-94cf-7d2f115c6788 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-d07ccd6f-ff21-4ff4-9eea-7cc9b9cb1e89 req-9996f894-6259-4894-94cf-7d2f115c6788 tempest-AttachVolumeTestJSON-1788094156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-0db6b773-8743-49c7-b981-24ba6732656c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f069e53d-56c5-49d4-8b9e-1f1492de0de7', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:59:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-d07ccd6f-ff21-4ff4-9eea-7cc9b9cb1e89 req-9996f894-6259-4894-94cf-7d2f115c6788 tempest-AttachVolumeTestJSON-1788094156 None] attachment_update completed successfully. Aug 24 09:59:18 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-b5492202-6fcd-48f3-a66a-f304722c80a8 req-029d5a14-6890-48d7-8356-67f4639ab461 tempest-AttachVolumeTestJSON-1788094156 None] Terminate volume connection completed successfully. Aug 24 09:59:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-b5492202-6fcd-48f3-a66a-f304722c80a8 req-029d5a14-6890-48d7-8356-67f4639ab461 tempest-AttachVolumeTestJSON-1788094156 None] Deleting attachment a52ff07a-788f-4c18-aedc-505ad4059a2d. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:59:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-6783470d-43c7-4cae-babe-06a119426a73 req-2a2de66c-4059-4b7a-b12d-54c27e9ba0f8 tempest-AttachVolumeTestJSON-1788094156 None] Terminate volume connection completed successfully. Aug 24 09:59:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-6783470d-43c7-4cae-babe-06a119426a73 req-2a2de66c-4059-4b7a-b12d-54c27e9ba0f8 tempest-AttachVolumeTestJSON-1788094156 None] Deleting attachment f069e53d-56c5-49d4-8b9e-1f1492de0de7. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:59:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-ffb732eb-7b74-4eae-ba1b-2eb15cc10ec6 tempest-ServerActionsTestOtherA-873819248 None] Terminate volume connection completed successfully. Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-ffb732eb-7b74-4eae-ba1b-2eb15cc10ec6 tempest-ServerActionsTestOtherA-873819248 None] Deleting attachment 85c6e4a2-3b4e-4638-bb33-b14726c6517d. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "cinder-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "cinder-quobyte-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-quobyte-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d917b87-329d-4f73-b7dc-d64f428eefe4]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:23 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f Aug 24 09:59:23 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:24 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" returned: 0 in 0.544s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:24 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f Aug 24 09:59:24 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:24 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-quobyte-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f" released by "delete_volume" :: held 1.056s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG cinder.quota [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Created reservations ['04563ffc-498d-4b54-b680-fc86c1e923ac', '58b74ef9-f989-491e-8932-5f9dd752ae44', '3d0ad7b2-f1a0-4fe9-bb1e-092fc0345445', '7ef1e743-e595-4058-a43e-902cec187997'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:24 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:24 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:25 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG cinder.manager [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Deleted volume successfully. Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-693c061a-ad40-446c-9843-5ee3c7c041f9 req-32798b1b-bf40-4391-80fd-025ec38f252d tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-51a6dbbc-a6f3-4f0f-9b43-e74a9c09526f-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "cinder-8a928bc1-0595-46c5-9dc6-ed8f081a41ed-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-8a928bc1-0595-46c5-9dc6-ed8f081a41ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "cinder-quobyte-8a928bc1-0595-46c5-9dc6-ed8f081a41ed" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-quobyte-8a928bc1-0595-46c5-9dc6-ed8f081a41ed" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2851122-bc3a-4d48-9d8f-14f09a229158]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:25 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed Aug 24 09:59:25 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:26 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed" returned: 0 in 0.426s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:26 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed Aug 24 09:59:26 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:26 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:26 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:26 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8a928bc1-0595-46c5-9dc6-ed8f081a41ed" returned: 0 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-quobyte-8a928bc1-0595-46c5-9dc6-ed8f081a41ed" released by "delete_volume" :: held 0.805s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:26 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.331s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Created reservations ['3e4f713e-03a0-42dd-9d01-58d1e03526fc', '2a2262b4-5d4d-4742-a309-3dbb4de6ef83', '0a5ae81f-a960-4acf-842f-19fe39fb1990', '4b218f89-c260-49a9-97cc-8e904c5694f9'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:26 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:26 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:27 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.352s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Deleted volume successfully. Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8a64d811-5a19-49e3-a634-c6c6e1cf1bf8 tempest-ServerActionsTestOtherA-873819248 None] Lock "cinder-8a928bc1-0595-46c5-9dc6-ed8f081a41ed-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "cinder-0db6b773-8743-49c7-b981-24ba6732656c-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-0db6b773-8743-49c7-b981-24ba6732656c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "cinder-quobyte-0db6b773-8743-49c7-b981-24ba6732656c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-quobyte-0db6b773-8743-49c7-b981-24ba6732656c" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e05854-3b93-4dbf-b136-24513ca9575a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:27 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c Aug 24 09:59:27 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:28 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c" returned: 0 in 0.647s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:28 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c Aug 24 09:59:28 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:28 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0db6b773-8743-49c7-b981-24ba6732656c" returned: 0 in 0.515s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-quobyte-0db6b773-8743-49c7-b981-24ba6732656c" released by "delete_volume" :: held 1.237s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Created reservations ['76a84e71-7fec-4f2c-abb4-c526c673e5e7', 'da537689-ef86-4cfe-ad2c-8d99e02b25f7', '540471c9-d56c-4175-b41b-72a92e07ca8c', '185f29b4-a151-42e1-b56b-cb4ceffc00c8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:28 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:28 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:29 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Deleted volume successfully. Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c548fc0-8921-4008-be1d-17bc25509347 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-0db6b773-8743-49c7-b981-24ba6732656c-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "cinder-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "cinder-quobyte-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-quobyte-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2f427d-2bc9-4893-a619-272bbdb11267]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:29 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 Aug 24 09:59:29 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:30 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1" returned: 0 in 0.474s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:30 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1 Aug 24 09:59:30 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:30 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1" returned: 0 in 0.316s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-quobyte-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1" released by "delete_volume" :: held 0.851s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Created reservations ['196dda29-a5d1-4a9d-bec5-7cec2da52882', 'a4adc9d8-ab4c-4fb7-82fc-7750fe9acc42', 'c8e09271-346d-477f-8ff3-19e63eaece7a', '8f15e4e5-4d94-4780-89c7-b478b990d56e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:30 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:30 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "cinder-4474ee22-c2ba-4c19-82be-ddaee4c0616a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-4474ee22-c2ba-4c19-82be-ddaee4c0616a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "cinder-quobyte-4474ee22-c2ba-4c19-82be-ddaee4c0616a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-quobyte-4474ee22-c2ba-4c19-82be-ddaee4c0616a" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:31 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.396s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Deleted volume successfully. Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e627c79e-cc74-434f-ad7e-6a6ce504d905]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c873776d-4806-4f37-88f2-80651faf300b tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-f7cbbf29-ffc8-4bec-a8d8-9715e8ca1ba1-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:31 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a Aug 24 09:59:31 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:31 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a" returned: 0 in 0.510s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:31 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a Aug 24 09:59:31 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Flow 'volume_create_manager' (3eb924f0-5461-4a3b-9d12-2fa0ccf96415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bc3a80-c540-4cee-9e5b-e3c9a679e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bc3a80-c540-4cee-9e5b-e3c9a679e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1852339895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6424987a-de61-4117-9240-b727b9f94923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffb983e90dd4c2c952441add7cb67cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:32Z,use_quota=True,user_id='f14b6c23e0094f79969db53646849ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433a6446-792d-4da9-9ccb-abb8af78b442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433a6446-792d-4da9-9ccb-abb8af78b442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5dd828-7bc5-4ebc-9baa-79c7f9fa2eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5dd828-7bc5-4ebc-9baa-79c7f9fa2eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6424987a-de61-4117-9240-b727b9f94923', 'volume_name': 'volume-6424987a-de61-4117-9240-b727b9f94923', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef5901a-449f-45d0-a35d-becef0a86eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef5901a-449f-45d0-a35d-becef0a86eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a51f58f-4377-477a-aac9-6215b1946b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:32 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Volume 6424987a-de61-4117-9240-b727b9f94923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6424987a-de61-4117-9240-b727b9f94923', 'volume_size': 1} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1852339895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6424987a-de61-4117-9240-b727b9f94923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffb983e90dd4c2c952441add7cb67cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:32Z,use_quota=True,user_id='f14b6c23e0094f79969db53646849ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Creating volume 6424987a-de61-4117-9240-b727b9f94923 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:32 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:32 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 1073741824 Aug 24 09:59:32 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:32 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4474ee22-c2ba-4c19-82be-ddaee4c0616a" returned: 0 in 0.494s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-quobyte-4474ee22-c2ba-4c19-82be-ddaee4c0616a" released by "delete_volume" :: held 1.085s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Created reservations ['ac1f759b-f876-4eb9-8891-92b42c41d205', '2d271b1d-087f-4700-8359-345f0c513b1c', 'e43c3a82-8a55-4737-a961-3379827de49c', '551373b5-fe12-4148-88b0-de845c86237a'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:32 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:32 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:32 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.294s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Deleted volume successfully. Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ccdb17ee-ec6a-49fa-aaaa-8f80540f0280 tempest-AttachVolumeTestJSON-1788094156 None] Lock "cinder-4474ee22-c2ba-4c19-82be-ddaee4c0616a-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:32 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 1073741824" returned: 0 in 0.612s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:32 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 Aug 24 09:59:32 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:33 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a51f58f-4377-477a-aac9-6215b1946b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6424987a-de61-4117-9240-b727b9f94923', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07895662-c795-4068-81c7-57f0db9d1899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:33 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Volume volume-6424987a-de61-4117-9240-b727b9f94923 (6424987a-de61-4117-9240-b727b9f94923): created successfully Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07895662-c795-4068-81c7-57f0db9d1899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Flow 'volume_create_manager' (3eb924f0-5461-4a3b-9d12-2fa0ccf96415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d7ef024d-da15-4afd-994c-070fd9b9c3d2 tempest-AttachVolumeNegativeTest-44824851 None] Created volume successfully. Aug 24 09:59:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-77de489f-068a-4f1f-ad11-8fefdb6bd35e req-409b2c62-6ff6-456f-93cb-bb340ba404f4 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-77de489f-068a-4f1f-ad11-8fefdb6bd35e req-409b2c62-6ff6-456f-93cb-bb340ba404f4 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-77de489f-068a-4f1f-ad11-8fefdb6bd35e req-409b2c62-6ff6-456f-93cb-bb340ba404f4 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-77de489f-068a-4f1f-ad11-8fefdb6bd35e req-409b2c62-6ff6-456f-93cb-bb340ba404f4 tempest-AttachVolumeNegativeTest-44824851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-6424987a-de61-4117-9240-b727b9f94923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b15ca568-1876-4c2d-b848-004ba2dcf252', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 09:59:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-77de489f-068a-4f1f-ad11-8fefdb6bd35e req-409b2c62-6ff6-456f-93cb-bb340ba404f4 tempest-AttachVolumeNegativeTest-44824851 None] attachment_update completed successfully. Aug 24 09:59:38 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-2a42b6a0-28ac-4f31-8eda-99afa5314ef0 req-824ea2c5-42cc-412c-852c-c2c4faf1a7e7 tempest-AttachVolumeNegativeTest-44824851 None] Terminate volume connection completed successfully. Aug 24 09:59:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-2a42b6a0-28ac-4f31-8eda-99afa5314ef0 req-824ea2c5-42cc-412c-852c-c2c4faf1a7e7 tempest-AttachVolumeNegativeTest-44824851 None] Deleting attachment b15ca568-1876-4c2d-b848-004ba2dcf252. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=108,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Flow 'volume_create_manager' (d24c5725-f9c2-4ea4-8b20-ae9ac7e09271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280771a5-6aa1-4d14-bfd4-c57e5c2cbab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280771a5-6aa1-4d14-bfd4-c57e5c2cbab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1809815433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4def1fa2-efd8-4ca6-8392-8d743f3504f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af339ef79916473c91971c4b3a4f34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:45Z,use_quota=True,user_id='24cd0c5f66e94a048a70fa0351594e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bc8525-24c3-46e1-a0b6-7c425d209fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bc8525-24c3-46e1-a0b6-7c425d209fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8faa4692-6419-4bff-ab8d-314e8d8e238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8faa4692-6419-4bff-ab8d-314e8d8e238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4def1fa2-efd8-4ca6-8392-8d743f3504f3', 'volume_name': 'volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6953512c-083c-4e76-9ebb-0384595fe251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6953512c-083c-4e76-9ebb-0384595fe251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079b14f3-dd20-48ac-a6c5-9fb7816ccf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:45 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Volume 4def1fa2-efd8-4ca6-8392-8d743f3504f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3', 'volume_size': 1} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1809815433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4def1fa2-efd8-4ca6-8392-8d743f3504f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af339ef79916473c91971c4b3a4f34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:45Z,use_quota=True,user_id='24cd0c5f66e94a048a70fa0351594e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Creating volume 4def1fa2-efd8-4ca6-8392-8d743f3504f3 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:45 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:45 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 1073741824 Aug 24 09:59:45 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:46 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 1073741824" returned: 0 in 0.594s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:46 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 Aug 24 09:59:46 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:46 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3" returned: 0 in 0.341s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079b14f3-dd20-48ac-a6c5-9fb7816ccf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b62fa0-93dd-4479-921d-b765959ce1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:46 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Volume volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 (4def1fa2-efd8-4ca6-8392-8d743f3504f3): created successfully Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b62fa0-93dd-4479-921d-b765959ce1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Flow 'volume_create_manager' (d24c5725-f9c2-4ea4-8b20-ae9ac7e09271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-59d5addb-d8f8-4b8e-8bd2-7976f5790267 tempest-VolumesTestJSON-1704308790 None] Created volume successfully. Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Flow 'volume_create_manager' (4146a118-d915-44f4-ad7f-3e396a69bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5809d087-8eff-497e-b318-f1beb2058247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5809d087-8eff-497e-b318-f1beb2058247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1567197437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8881a646-5494-467a-81d9-1dc924554b21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af339ef79916473c91971c4b3a4f34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:48Z,use_quota=True,user_id='24cd0c5f66e94a048a70fa0351594e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efca04b-043c-4944-8166-e9fdc37453c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7efca04b-043c-4944-8166-e9fdc37453c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a28b8b-fa1c-472f-ab6e-527b633b0b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a28b8b-fa1c-472f-ab6e-527b633b0b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8881a646-5494-467a-81d9-1dc924554b21', 'volume_name': 'volume-8881a646-5494-467a-81d9-1dc924554b21', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2c1e95-dbaf-4960-9edb-b7ead6109edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f2c1e95-dbaf-4960-9edb-b7ead6109edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed0b5ed-1b6d-4bce-a1d8-efd147809fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Volume 8881a646-5494-467a-81d9-1dc924554b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8881a646-5494-467a-81d9-1dc924554b21', 'volume_size': 1} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1567197437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8881a646-5494-467a-81d9-1dc924554b21,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af339ef79916473c91971c4b3a4f34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:48Z,use_quota=True,user_id='24cd0c5f66e94a048a70fa0351594e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Creating volume 8881a646-5494-467a-81d9-1dc924554b21 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:48 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:48 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 1073741824 Aug 24 09:59:48 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Flow 'volume_create_manager' (d2c631cd-e315-4be0-93cd-f89ad6e338b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e2a1f6-6235-44cb-90d6-52ea35290c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e2a1f6-6235-44cb-90d6-52ea35290c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-687538332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e41536-00b2-438e-92fa-9db052436742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b57308f81548c999a7500dac631f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:49Z,use_quota=True,user_id='0cf90bfda22241c8803b3a3012b71189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14060616-0c29-4d46-86f8-4faaec9305cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14060616-0c29-4d46-86f8-4faaec9305cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9260ffdf-382c-4ffc-996c-ff368a8b1f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9260ffdf-382c-4ffc-996c-ff368a8b1f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e41536-00b2-438e-92fa-9db052436742', 'volume_name': 'volume-70e41536-00b2-438e-92fa-9db052436742', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c8d42a-db85-4cff-8978-9f40d3dc0f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c8d42a-db85-4cff-8978-9f40d3dc0f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e39df1-80a0-482b-8b87-1430e4202e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Volume 70e41536-00b2-438e-92fa-9db052436742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e41536-00b2-438e-92fa-9db052436742', 'volume_size': 1} Aug 24 09:59:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:49 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 1073741824" returned: 0 in 0.606s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:49 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 Aug 24 09:59:49 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:49 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-687538332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e41536-00b2-438e-92fa-9db052436742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b57308f81548c999a7500dac631f39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:49Z,use_quota=True,user_id='0cf90bfda22241c8803b3a3012b71189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Creating volume 70e41536-00b2-438e-92fa-9db052436742 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:49 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 1073741824 Aug 24 09:59:49 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed0b5ed-1b6d-4bce-a1d8-efd147809fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8881a646-5494-467a-81d9-1dc924554b21', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9d43bb-bf0a-4c6a-bd7d-7d8fc9b74d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:49 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Volume volume-8881a646-5494-467a-81d9-1dc924554b21 (8881a646-5494-467a-81d9-1dc924554b21): created successfully Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9d43bb-bf0a-4c6a-bd7d-7d8fc9b74d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Flow 'volume_create_manager' (4146a118-d915-44f4-ad7f-3e396a69bebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5699664a-a9b0-484a-a3cf-dd52f7bd4424 tempest-VolumesTestJSON-1704308790 None] Created volume successfully. Aug 24 09:59:50 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 1073741824" returned: 0 in 0.585s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:50 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 Aug 24 09:59:50 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:50 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e39df1-80a0-482b-8b87-1430e4202e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e41536-00b2-438e-92fa-9db052436742', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b589b-445a-4668-a442-59270a3213b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:50 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Volume volume-70e41536-00b2-438e-92fa-9db052436742 (70e41536-00b2-438e-92fa-9db052436742): created successfully Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b589b-445a-4668-a442-59270a3213b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Flow 'volume_create_manager' (d2c631cd-e315-4be0-93cd-f89ad6e338b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b7965f6b-c489-4edb-a4d4-dc1da6252acf tempest-AbsoluteLimitsTests-1817363325 None] Created volume successfully. Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Flow 'volume_create_manager' (8aba722e-1dff-4112-a609-81fb16e6d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00d5df6-db75-4d73-a7d5-83ea709d3d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b00d5df6-db75-4d73-a7d5-83ea709d3d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1963238407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d74631-dac5-458a-91dd-16bad0a13f4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af339ef79916473c91971c4b3a4f34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:51Z,use_quota=True,user_id='24cd0c5f66e94a048a70fa0351594e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12aa732-40b3-422a-b00e-8756dc80a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12aa732-40b3-422a-b00e-8756dc80a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc45d16-73ad-4eea-b1c9-141a9b7202b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc45d16-73ad-4eea-b1c9-141a9b7202b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d74631-dac5-458a-91dd-16bad0a13f4f', 'volume_name': 'volume-c3d74631-dac5-458a-91dd-16bad0a13f4f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ec174d-2947-42c4-990f-686550811325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ec174d-2947-42c4-990f-686550811325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feac9554-b83a-4180-89ce-32cf2719f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:51 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Volume c3d74631-dac5-458a-91dd-16bad0a13f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d74631-dac5-458a-91dd-16bad0a13f4f', 'volume_size': 1} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T07:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1963238407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d74631-dac5-458a-91dd-16bad0a13f4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='af339ef79916473c91971c4b3a4f34bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T07:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T07:59:51Z,use_quota=True,user_id='24cd0c5f66e94a048a70fa0351594e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Creating volume c3d74631-dac5-458a-91dd-16bad0a13f4f {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 09:59:51 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:51 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f 1073741824 Aug 24 09:59:51 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Acquiring lock "cinder-70e41536-00b2-438e-92fa-9db052436742-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Lock "cinder-70e41536-00b2-438e-92fa-9db052436742-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Acquiring lock "cinder-quobyte-70e41536-00b2-438e-92fa-9db052436742" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Lock "cinder-quobyte-70e41536-00b2-438e-92fa-9db052436742" acquired by "delete_volume" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ec6674-8f7a-4fd8-b069-adf2cf3346dd]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:52 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 Aug 24 09:59:52 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:52 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f 1073741824" returned: 0 in 0.940s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:52 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f Aug 24 09:59:52 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:52 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742" returned: 0 in 0.607s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:52 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742 Aug 24 09:59:52 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:52 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f" returned: 0 in 0.334s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feac9554-b83a-4180-89ce-32cf2719f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d74631-dac5-458a-91dd-16bad0a13f4f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c9df6c-65e4-44e1-a470-fcaa999b238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 09:59:52 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Volume volume-c3d74631-dac5-458a-91dd-16bad0a13f4f (c3d74631-dac5-458a-91dd-16bad0a13f4f): created successfully Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c9df6c-65e4-44e1-a470-fcaa999b238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 09:59:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Flow 'volume_create_manager' (8aba722e-1dff-4112-a609-81fb16e6d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 09:59:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7c54c350-cdcb-479a-ba98-10f7ee8d2a96 tempest-VolumesTestJSON-1704308790 None] Created volume successfully. Aug 24 09:59:53 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-70e41536-00b2-438e-92fa-9db052436742" returned: 0 in 0.313s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Lock "cinder-quobyte-70e41536-00b2-438e-92fa-9db052436742" released by "delete_volume" :: held 0.975s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Created reservations ['b2db5ba1-bcc5-45f0-99c5-d003182cd52d', '2ea2656f-8e24-48f4-8ca1-7a972337aac1', '9f0b10d6-c603-4ab0-acda-a42852d535bd', '9c733a82-35a8-45b3-879c-4ebb1be76be2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:53 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:53 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:53 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.383s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Deleted volume successfully. Aug 24 09:59:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f37b5509-a4d0-4129-96cd-78b67c3e30e4 tempest-AbsoluteLimitsTests-1817363325 None] Lock "cinder-70e41536-00b2-438e-92fa-9db052436742-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "cinder-c3d74631-dac5-458a-91dd-16bad0a13f4f-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-c3d74631-dac5-458a-91dd-16bad0a13f4f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "cinder-quobyte-c3d74631-dac5-458a-91dd-16bad0a13f4f" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-quobyte-c3d74631-dac5-458a-91dd-16bad0a13f4f" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:54 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc167b-024c-4063-b726-6bade052a9f6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:55 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f Aug 24 09:59:55 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:55 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f" returned: 0 in 0.827s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:55 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f Aug 24 09:59:55 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:56 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c3d74631-dac5-458a-91dd-16bad0a13f4f" returned: 0 in 0.470s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-quobyte-c3d74631-dac5-458a-91dd-16bad0a13f4f" released by "delete_volume" :: held 1.386s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Created reservations ['041251e3-ed6b-4022-a0e9-5cf733820da0', '7b34e3f1-ec6a-4e8d-a6a8-3cf3f98a52fb', '391a8049-0d94-4f1e-ad04-2f52ddfd173f', '3f1c3a4e-af90-42dd-a73c-f6d3ebbd85a8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:56 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:56 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:57 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.552s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Deleted volume successfully. Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "cinder-8881a646-5494-467a-81d9-1dc924554b21-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1b6f3847-58d1-40ff-8d83-446ab6bcc5b5 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-c3d74631-dac5-458a-91dd-16bad0a13f4f-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-8881a646-5494-467a-81d9-1dc924554b21-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "cinder-quobyte-8881a646-5494-467a-81d9-1dc924554b21" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-quobyte-8881a646-5494-467a-81d9-1dc924554b21" acquired by "delete_volume" :: waited 0.056s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df60c52-e818-4b40-9b68-9ba862809569]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:57 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 Aug 24 09:59:57 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:58 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21" returned: 0 in 0.650s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:58 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21 Aug 24 09:59:58 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:58 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8881a646-5494-467a-81d9-1dc924554b21" returned: 0 in 0.534s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-quobyte-8881a646-5494-467a-81d9-1dc924554b21" released by "delete_volume" :: held 1.256s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Created reservations ['d86caa04-3fc3-4908-98e4-b87a487d7518', 'db48aa8e-b944-4e9a-9184-e1e30722e0e2', 'cd2fa5b5-61e7-4b99-92d6-028824827a1e', '9af5b06b-1200-40a3-aa67-632affd9ec8e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 09:59:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 09:59:58 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 09:59:58 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 09:59:59 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.358s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 09:59:59 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Deleted volume successfully. Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-99cdcf22-d0c3-45d0-8215-b2b5ef68de26 tempest-VolumesTestJSON-1704308790 None] Lock "cinder-8881a646-5494-467a-81d9-1dc924554b21-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Acquiring lock "cinder-4def1fa2-efd8-4ca6-8392-8d743f3504f3-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Lock "cinder-4def1fa2-efd8-4ca6-8392-8d743f3504f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Acquiring lock "cinder-quobyte-4def1fa2-efd8-4ca6-8392-8d743f3504f3" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Lock "cinder-quobyte-4def1fa2-efd8-4ca6-8392-8d743f3504f3" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[051daf99-3458-4c09-b034-90c8444f7de5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 09:59:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:00 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 Aug 24 10:00:00 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:00 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3" returned: 0 in 0.648s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:00 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3 Aug 24 10:00:00 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:00 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4def1fa2-efd8-4ca6-8392-8d743f3504f3" returned: 0 in 0.403s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Lock "cinder-quobyte-4def1fa2-efd8-4ca6-8392-8d743f3504f3" released by "delete_volume" :: held 1.136s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:00 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Created reservations ['1d21f625-0fda-4158-a03a-454d4d623097', '3baee5fa-81b9-4d7c-bdc7-0878e5d9fa55', '339d132f-4837-40bc-a797-ef505caebaab', '419b08ac-dd06-4bd2-9ff5-f827f7c6f3bd'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:01 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:01 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:01 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Deleted volume successfully. Aug 24 10:00:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-590bc1b4-e48c-4b75-90fa-36278a33184b tempest-VolumesTestJSON-1704308790 None] Lock "cinder-4def1fa2-efd8-4ca6-8392-8d743f3504f3-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=118,cinder:SELECT=88,cinder:INSERT=30,cinder:DELETE=11 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Flow 'volume_create_manager' (e08f9c55-e9f0-4bb6-8218-d87750c637e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436cbf2d-d680-4548-abbb-f5d6296c0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436cbf2d-d680-4548-abbb-f5d6296c0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1071989366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e604a8-0229-474f-a2b0-5a64face84f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b0f825fe384910808e80a4492c30d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:05Z,use_quota=True,user_id='5f2dbaf9fbdb4ef0b681c27bf0c7abfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad08c8c-b8e1-4eb5-b5f4-1845009bc4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad08c8c-b8e1-4eb5-b5f4-1845009bc4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98819003-bce7-4407-8043-e179b80847a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98819003-bce7-4407-8043-e179b80847a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e604a8-0229-474f-a2b0-5a64face84f7', 'volume_name': 'volume-f8e604a8-0229-474f-a2b0-5a64face84f7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf86bf4-a5c8-4cf4-aed3-941522bac6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cf86bf4-a5c8-4cf4-aed3-941522bac6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd63bc5-1d36-49d5-9768-cae54fb725ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Volume f8e604a8-0229-474f-a2b0-5a64face84f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e604a8-0229-474f-a2b0-5a64face84f7', 'volume_size': 1} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1071989366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e604a8-0229-474f-a2b0-5a64face84f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b0f825fe384910808e80a4492c30d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:05Z,use_quota=True,user_id='5f2dbaf9fbdb4ef0b681c27bf0c7abfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Creating volume f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:04 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:00:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:04 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 1073741824 Aug 24 10:00:04 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:05 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 1073741824" returned: 0 in 0.703s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:05 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 Aug 24 10:00:05 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:06 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7" returned: 0 in 0.389s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd63bc5-1d36-49d5-9768-cae54fb725ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e604a8-0229-474f-a2b0-5a64face84f7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d086dd-20cc-4698-ba7c-079483fd13f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Volume volume-f8e604a8-0229-474f-a2b0-5a64face84f7 (f8e604a8-0229-474f-a2b0-5a64face84f7): created successfully Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d086dd-20cc-4698-ba7c-079483fd13f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Flow 'volume_create_manager' (e08f9c55-e9f0-4bb6-8218-d87750c637e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8351c28f-5c7f-4053-87d8-bfac2a7bbd17 tempest-VolumesDeleteCascade-102156288 None] Created volume successfully. Aug 24 10:00:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Creating offline snapshot 33709227-c84c-48c8-9d6b-2a97221f5cd4 of volume f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f934ac60-5401-445a-b7bb-ad05d751a045]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:08 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 Aug 24 10:00:08 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:08 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7" returned: 0 in 0.713s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:08 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 1G Aug 24 10:00:08 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:09 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 1G" returned: 0 in 0.684s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e604a8-0229-474f-a2b0-5a64face84f7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:09 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e604a8-0229-474f-a2b0-5a64face84f7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:09 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:09 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e604a8-0229-474f-a2b0-5a64face84f7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.675s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:09 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 is being set with open permissions: ugo+rw Aug 24 10:00:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-87f18a41-6b01-4526-aefe-684220563226 tempest-GroupsV320Test-2046768742 None] Group tempest-GroupsV320Test-Group-1221289886: creating Aug 24 10:00:09 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:09 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-87f18a41-6b01-4526-aefe-684220563226 tempest-GroupsV320Test-2046768742 None] Group tempest-GroupsV320Test-Group-1221289886: created successfully Aug 24 10:00:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-87f18a41-6b01-4526-aefe-684220563226 tempest-GroupsV320Test-2046768742 None] Create group completed successfully. Aug 24 10:00:10 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.307s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:10 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info Aug 24 10:00:10 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:10 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:10 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info is being set with open permissions: ugo+rw Aug 24 10:00:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:10 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info Aug 24 10:00:10 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:11 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.info" returned: 0 in 0.861s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.899s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-513be012-a57d-4952-9267-dac106bf4642 tempest-VolumesDeleteCascade-102156288 None] Create snapshot completed successfully Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Created reservations ['8736ac7b-8909-4d52-934d-b265194c2e35'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Creating offline snapshot 0977ee1b-6142-4403-abdb-bf146a599a7f of volume f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c1c2a5-ffbe-4918-9d5a-68c156b20635]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:12 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:12 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:12 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:12 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:12 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.258s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c4d46c8f-58e9-452f-aa87-e6cc91da8858 tempest-GroupsV320Test-2046768742 None] Delete group completed successfully. Aug 24 10:00:12 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e604a8-0229-474f-a2b0-5a64face84f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:12 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f 1G Aug 24 10:00:12 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:13 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f 1G" returned: 0 in 0.552s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:13 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f Aug 24 10:00:13 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:13 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f" returned: 0 in 0.501s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:13 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f is being set with open permissions: ugo+rw Aug 24 10:00:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:13 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f Aug 24 10:00:13 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:14 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-34347704-7bbc-46da-8432-9805c861d584 tempest-VolumesDeleteCascade-102156288 None] Create snapshot completed successfully Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-f8e604a8-0229-474f-a2b0-5a64face84f7-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-f8e604a8-0229-474f-a2b0-5a64face84f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Performing cascade delete. {{(pid=94039) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-0977ee1b-6142-4403-abdb-bf146a599a7f-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-0977ee1b-6142-4403-abdb-bf146a599a7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-0977ee1b-6142-4403-abdb-bf146a599a7f" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-0977ee1b-6142-4403-abdb-bf146a599a7f" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Deleting offline snapshot 0977ee1b-6142-4403-abdb-bf146a599a7f of volume f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] snapshot_file for this snap is: volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9800dec0-2313-48c7-81a0-4bc4d4025cdf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:14 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f Aug 24 10:00:14 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:15 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f" returned: 0 in 0.511s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e604a8-0229-474f-a2b0-5a64face84f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac107958-8ff5-4653-b47f-5b7855c9ad0f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:15 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:15 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:15 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.601s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e604a8-0229-474f-a2b0-5a64face84f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:15 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f Aug 24 10:00:15 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:16 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f" returned: 0 in 0.693s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:16 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f Aug 24 10:00:16 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:16 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.0977ee1b-6142-4403-abdb-bf146a599a7f" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-0977ee1b-6142-4403-abdb-bf146a599a7f" released by "_delete_snapshot" :: held 2.308s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" released by "delete_snapshot" :: held 2.360s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Created reservations ['a0463cfd-eaff-42f1-862c-c40f8ff74a8f', '7ed3bca7-9e46-4bd4-a4c5-22f9263d317c', '741dbe50-31cd-4864-a77e-5aab03f540f0', 'ff2d3a3f-e234-4568-b8f4-357a3e857dfc'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Delete snapshot completed successfully. Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-0977ee1b-6142-4403-abdb-bf146a599a7f-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-33709227-c84c-48c8-9d6b-2a97221f5cd4-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-33709227-c84c-48c8-9d6b-2a97221f5cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-33709227-c84c-48c8-9d6b-2a97221f5cd4" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-33709227-c84c-48c8-9d6b-2a97221f5cd4" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Deleting offline snapshot 33709227-c84c-48c8-9d6b-2a97221f5cd4 of volume f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] snapshot_file for this snap is: volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c1729-e005-425e-8f00-52216365f4d6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:17 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:17 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:17 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.520s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e604a8-0229-474f-a2b0-5a64face84f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77a33e-ee45-4198-9b3e-a10ef9c33a3a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:18 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 Aug 24 10:00:18 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:18 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7" returned: 0 in 0.483s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:18 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:18 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:18 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.510s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:18 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4 Aug 24 10:00:18 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:19 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7.33709227-c84c-48c8-9d6b-2a97221f5cd4" returned: 0 in 0.298s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-33709227-c84c-48c8-9d6b-2a97221f5cd4" released by "_delete_snapshot" :: held 1.995s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" released by "delete_snapshot" :: held 2.090s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Created reservations ['07f247be-32d8-4b85-9dd1-9c1480ec5fd3', '8d00194d-1895-4c53-ad0a-c152c2d864ff', '55ffd1b0-135c-494a-8088-0af160e5c1f7', 'd8e028eb-e5b5-4c9e-8a98-ce82835f77e5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Delete snapshot completed successfully. Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-33709227-c84c-48c8-9d6b-2a97221f5cd4-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Snapshots deleted, issuing volume delete {{(pid=94039) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" acquired by "delete_volume" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c8616-fc1d-4863-8174-27637d1649c1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:19 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 Aug 24 10:00:19 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:19 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7" returned: 0 in 0.471s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:20 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7 Aug 24 10:00:20 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:20 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8e604a8-0229-474f-a2b0-5a64face84f7" returned: 0 in 0.428s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-f8e604a8-0229-474f-a2b0-5a64face84f7" released by "delete_volume" :: held 0.979s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Flow 'volume_create_manager' (4c1e3c9a-0020-47bf-803b-5006c645ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0e77a5-0f5f-417b-bf7f-8ee5abbafa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0e77a5-0f5f-417b-bf7f-8ee5abbafa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1236609980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d348d92e-e0d7-4173-b6c3-6fe9129ffca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f6b0ea9714471ca47acfe87d2338e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:20Z,use_quota=True,user_id='e8b824b504274c338f37504bb5806fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8791a450-ce6a-4e34-a6ba-5f9c0826f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8791a450-ce6a-4e34-a6ba-5f9c0826f83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc81471-0a01-4b9c-8c1c-b5489d99a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc81471-0a01-4b9c-8c1c-b5489d99a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd348d92e-e0d7-4173-b6c3-6fe9129ffca8', 'volume_name': 'volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a656a72a-f484-43be-86cf-342d760804f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a656a72a-f484-43be-86cf-342d760804f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd60c1f0-70e0-42fb-9a5b-48663c089624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8', 'volume_size': 1} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1236609980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d348d92e-e0d7-4173-b6c3-6fe9129ffca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f6b0ea9714471ca47acfe87d2338e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:20Z,use_quota=True,user_id='e8b824b504274c338f37504bb5806fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Creating volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:20 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Created reservations ['9acd3552-f9d8-4d7f-b32f-39110edbb2be', '021960a4-a077-4406-823a-5167ed9fecd8', '0d2d5c47-4015-48bc-a0e8-fa03ca89e905', '32760fdf-729f-452f-809a-bb47fcaa8188'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:20 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 1073741824 Aug 24 10:00:20 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:20 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:20 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:20 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Deleted volume successfully. Aug 24 10:00:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f85cee9-3f49-4203-9ee7-35ee78e582a9 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-f8e604a8-0229-474f-a2b0-5a64face84f7-delete_volume" released by "delete_volume" :: held 6.581s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:21 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 1073741824" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:21 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 Aug 24 10:00:21 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:21 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd60c1f0-70e0-42fb-9a5b-48663c089624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09bffd5-a124-4302-9bac-0f356eeda0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Volume volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 (d348d92e-e0d7-4173-b6c3-6fe9129ffca8): created successfully Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09bffd5-a124-4302-9bac-0f356eeda0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Flow 'volume_create_manager' (4c1e3c9a-0020-47bf-803b-5006c645ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0deab898-81da-40f4-a51a-562d25d66d1b tempest-SnapshotsActionsTest-1017097117 None] Created volume successfully. Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Flow 'volume_create_manager' (0b15f44a-6138-4224-8c5f-8dc1ac3b30c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4e22d4-37ff-4f7a-98e0-a0c7097227f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4e22d4-37ff-4f7a-98e0-a0c7097227f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2041810644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d35fd43-235d-4435-8715-8d6f58006309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b0f825fe384910808e80a4492c30d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:22Z,use_quota=True,user_id='5f2dbaf9fbdb4ef0b681c27bf0c7abfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45def5e-4dff-41c4-9390-55adb66444aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45def5e-4dff-41c4-9390-55adb66444aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d076ef25-59a5-4b9e-9d10-808faf3e63cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d076ef25-59a5-4b9e-9d10-808faf3e63cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d35fd43-235d-4435-8715-8d6f58006309', 'volume_name': 'volume-6d35fd43-235d-4435-8715-8d6f58006309', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41e775b-f0dd-4963-8a59-06851f1fdc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41e775b-f0dd-4963-8a59-06851f1fdc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd91f97f-fd9f-45f1-9428-b28a14c0a86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Volume 6d35fd43-235d-4435-8715-8d6f58006309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d35fd43-235d-4435-8715-8d6f58006309', 'volume_size': 1} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2041810644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d35fd43-235d-4435-8715-8d6f58006309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b0f825fe384910808e80a4492c30d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:22Z,use_quota=True,user_id='5f2dbaf9fbdb4ef0b681c27bf0c7abfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Creating volume 6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:21 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:00:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:21 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 1073741824 Aug 24 10:00:21 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:22 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 1073741824" returned: 0 in 0.448s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:22 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 Aug 24 10:00:22 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:22 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309" returned: 0 in 0.299s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Creating offline snapshot fdc188f4-9222-4851-a86f-feadd9d3d50c of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd91f97f-fd9f-45f1-9428-b28a14c0a86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d35fd43-235d-4435-8715-8d6f58006309', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3d8cda-87b9-499d-aa17-2d8655b8bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:22 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Volume volume-6d35fd43-235d-4435-8715-8d6f58006309 (6d35fd43-235d-4435-8715-8d6f58006309): created successfully Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3d8cda-87b9-499d-aa17-2d8655b8bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Flow 'volume_create_manager' (0b15f44a-6138-4224-8c5f-8dc1ac3b30c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606ff37-9e91-4526-9120-3237d5eb0504]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-36cc04a8-7bd7-4451-af40-082dcff4137d tempest-VolumesDeleteCascade-102156288 None] Created volume successfully. Aug 24 10:00:22 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 Aug 24 10:00:22 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:23 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" returned: 0 in 0.407s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:23 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c 1G Aug 24 10:00:23 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Flow 'volume_create_manager' (362df3dd-97f2-4e1a-958a-d824e1fc494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088d340f-0c64-4950-b400-a72248ff53f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088d340f-0c64-4950-b400-a72248ff53f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-944315043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982532cb-20fb-4d73-9192-2f4fba28b045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffb983e90dd4c2c952441add7cb67cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:24Z,use_quota=True,user_id='f14b6c23e0094f79969db53646849ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8ce57e-35ae-47da-bea0-1c01361a1768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a8ce57e-35ae-47da-bea0-1c01361a1768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d3f23-86f9-46ed-a470-92ab9016e2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042d3f23-86f9-46ed-a470-92ab9016e2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982532cb-20fb-4d73-9192-2f4fba28b045', 'volume_name': 'volume-982532cb-20fb-4d73-9192-2f4fba28b045', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1595fb02-e243-4147-9fcf-684d667e7c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1595fb02-e243-4147-9fcf-684d667e7c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d9adf0-514f-4e92-861d-e9a5ffd9b797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Volume 982532cb-20fb-4d73-9192-2f4fba28b045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982532cb-20fb-4d73-9192-2f4fba28b045', 'volume_size': 1} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:23 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c 1G" returned: 0 in 0.464s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:23 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:23 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:24 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.337s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:24 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c is being set with open permissions: ugo+rw Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:24 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:24 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:24 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:24 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info Aug 24 10:00:24 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:24 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info" returned: 0 in 0.268s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:24 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info is being set with open permissions: ugo+rw Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:24 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info Aug 24 10:00:24 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:24 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.info" returned: 0 in 0.298s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-944315043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982532cb-20fb-4d73-9192-2f4fba28b045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ffb983e90dd4c2c952441add7cb67cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:24Z,use_quota=True,user_id='f14b6c23e0094f79969db53646849ebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Creating volume 982532cb-20fb-4d73-9192-2f4fba28b045 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:24 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:00:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:25 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 1073741824 Aug 24 10:00:25 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-77894a27-0cc4-4d6b-a701-ed4fed203ff2 tempest-SnapshotsActionsTest-1017097117 None] Create snapshot completed successfully Aug 24 10:00:25 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 1073741824" returned: 0 in 0.440s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:25 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 Aug 24 10:00:25 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:25 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.640s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d9adf0-514f-4e92-861d-e9a5ffd9b797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982532cb-20fb-4d73-9192-2f4fba28b045', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c40010f-22e4-49e6-ac17-f95a4e577549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Creating offline snapshot b2bae081-d424-42c3-a5b0-3e87370e6558 of volume 6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a831b83-5d72-4491-a90e-69f454dbed7d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Volume volume-982532cb-20fb-4d73-9192-2f4fba28b045 (982532cb-20fb-4d73-9192-2f4fba28b045): created successfully Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c40010f-22e4-49e6-ac17-f95a4e577549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Flow 'volume_create_manager' (362df3dd-97f2-4e1a-958a-d824e1fc494d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b5cd55a5-a0c1-45b5-bba3-318d66c91456 tempest-AttachVolumeNegativeTest-44824851 None] Created volume successfully. Aug 24 10:00:25 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 Aug 24 10:00:25 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:26 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:26 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:26 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309" returned: 0 in 0.488s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:26 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 1G Aug 24 10:00:26 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:26 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.346s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:26 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 1G" returned: 0 in 0.508s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d35fd43-235d-4435-8715-8d6f58006309 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:26 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d35fd43-235d-4435-8715-8d6f58006309 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 Aug 24 10:00:26 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:27 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d35fd43-235d-4435-8715-8d6f58006309 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558" returned: 0 in 0.332s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:27 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 is being set with open permissions: ugo+rw Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:27 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 Aug 24 10:00:27 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-7f64a2f6-61d8-43e5-b72d-3476b0a5cbee req-f015386e-e21b-4a57-9fc4-19eb25fc211b tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:27 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558" returned: 0 in 0.264s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:27 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info Aug 24 10:00:27 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:27 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info" returned: 0 in 0.245s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:27 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info is being set with open permissions: ugo+rw Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:27 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info Aug 24 10:00:27 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:27 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.info" returned: 0 in 0.232s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.418s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Creating offline snapshot eb83ddf0-6402-4592-98db-2f8d042cad70 of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[029434bd-6d6a-4022-9296-4d9b0ae50717]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1134baf8-7778-4274-a342-e2d88c5835e9 tempest-VolumesDeleteCascade-102156288 None] Create snapshot completed successfully Aug 24 10:00:28 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:28 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:28 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.399s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:28 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 1G Aug 24 10:00:28 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:28 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 1G" returned: 0 in 0.459s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:28 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 Aug 24 10:00:28 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Flow 'volume_create_manager' (9de5301a-2588-42e2-aaac-f5e3a1de3b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801bfb19-5ca3-4b12-a7f8-fb0f59ee0080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801bfb19-5ca3-4b12-a7f8-fb0f59ee0080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-808133316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c5da540-96af-43d5-b128-821a19b7b03e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3b0f825fe384910808e80a4492c30d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2bae081-d424-42c3-a5b0-3e87370e6558,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:29Z,use_quota=True,user_id='5f2dbaf9fbdb4ef0b681c27bf0c7abfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab296783-7560-4b41-8d42-dd68ba7a56b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab296783-7560-4b41-8d42-dd68ba7a56b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8a00f6-c68e-476e-835e-060a192cfc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8a00f6-c68e-476e-835e-060a192cfc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c5da540-96af-43d5-b128-821a19b7b03e', 'volume_name': 'volume-0c5da540-96af-43d5-b128-821a19b7b03e', 'volume_size': 1, 'snapshot_id': 'b2bae081-d424-42c3-a5b0-3e87370e6558'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc66b589-1f44-423d-930b-94e6d4ef1574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc66b589-1f44-423d-930b-94e6d4ef1574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d034697c-c855-4791-8409-227c836ec900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:29 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Volume 0c5da540-96af-43d5-b128-821a19b7b03e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c5da540-96af-43d5-b128-821a19b7b03e', 'volume_size': 1, 'snapshot_id': 'b2bae081-d424-42c3-a5b0-3e87370e6558'} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:29 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70" returned: 0 in 0.287s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:29 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 is being set with open permissions: ugo+rw Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:29 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 Aug 24 10:00:29 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:29 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70" returned: 0 in 0.239s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.477s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-7f64a2f6-61d8-43e5-b72d-3476b0a5cbee req-f015386e-e21b-4a57-9fc4-19eb25fc211b tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.067s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-7f64a2f6-61d8-43e5-b72d-3476b0a5cbee req-f015386e-e21b-4a57-9fc4-19eb25fc211b tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.465s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-b2bae081-d424-42c3-a5b0-3e87370e6558-0c5da540-96af-43d5-b128-821a19b7b03e" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-b2bae081-d424-42c3-a5b0-3e87370e6558-0c5da540-96af-43d5-b128-821a19b7b03e" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Creating volume 0c5da540-96af-43d5-b128-821a19b7b03e from snapshot b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-0c5da540-96af-43d5-b128-821a19b7b03e" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d0096a67-aa7c-49fc-a27d-61727849efb9 tempest-SnapshotsActionsTest-1017097117 None] Create snapshot completed successfully Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-0c5da540-96af-43d5-b128-821a19b7b03e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] snapshot: b2bae081-d424-42c3-a5b0-3e87370e6558, volume: 0c5da540-96af-43d5-b128-821a19b7b03e, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-7f64a2f6-61d8-43e5-b72d-3476b0a5cbee req-f015386e-e21b-4a57-9fc4-19eb25fc211b tempest-AttachVolumeNegativeTest-44824851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-982532cb-20fb-4d73-9192-2f4fba28b045', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '530c44c6-010d-4d3e-9274-95356e081993', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e40d95a-4c09-4abe-a07d-7316629e427e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-7f64a2f6-61d8-43e5-b72d-3476b0a5cbee req-f015386e-e21b-4a57-9fc4-19eb25fc211b tempest-AttachVolumeNegativeTest-44824851 None] attachment_update completed successfully. Aug 24 10:00:29 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 Aug 24 10:00:29 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-eb83ddf0-6402-4592-98db-2f8d042cad70-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-eb83ddf0-6402-4592-98db-2f8d042cad70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-eb83ddf0-6402-4592-98db-2f8d042cad70" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-eb83ddf0-6402-4592-98db-2f8d042cad70" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Deleting offline snapshot eb83ddf0-6402-4592-98db-2f8d042cad70 of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] snapshot_file for this snap is: volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[300cedff-5b83-4c22-91fe-9ce858c85e19]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:30 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558" returned: 0 in 0.447s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d35fd43-235d-4435-8715-8d6f58006309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[97996f78-1d8b-425c-855c-9519ac7831ca]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:30 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 Aug 24 10:00:30 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:30 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 Aug 24 10:00:30 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:30 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309" returned: 0 in 0.400s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:00:30 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70" returned: 0 in 0.455s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:30 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e Aug 24 10:00:30 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce9b55e-0b4f-4e4f-b19d-8847757c77ec]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:30 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:30 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:30 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.409s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:31 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 Aug 24 10:00:31 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:31 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70" returned: 0 in 0.877s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:31 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70 Aug 24 10:00:31 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:32 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.eb83ddf0-6402-4592-98db-2f8d042cad70" returned: 0 in 0.516s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-eb83ddf0-6402-4592-98db-2f8d042cad70" released by "_delete_snapshot" :: held 2.431s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" released by "delete_snapshot" :: held 2.481s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:32 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Created reservations ['1d2487a3-e732-4be3-8259-9cb5f711ba3b', '6b3d3647-8a5f-4704-a6a5-9ce7e9e68557', 'c8e306ab-a238-4c31-902c-fab644997cdf', 'da332f1b-6ec1-48c9-afb2-2d10d04d3f90'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Delete snapshot completed successfully. Aug 24 10:00:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7b4d1582-ad45-4178-b8e2-ff81266d535b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-eb83ddf0-6402-4592-98db-2f8d042cad70-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-84c69820-1b56-4bd4-9f71-221e6b2d09be req-1d003ac5-40cc-4ac5-9dba-d9091b413c4c tempest-AttachVolumeNegativeTest-44824851 None] Terminate volume connection completed successfully. Aug 24 10:00:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-84c69820-1b56-4bd4-9f71-221e6b2d09be req-1d003ac5-40cc-4ac5-9dba-d9091b413c4c tempest-AttachVolumeNegativeTest-44824851 None] Deleting attachment 530c44c6-010d-4d3e-9274-95356e081993. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:00:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:36 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e" returned: 0 in 5.930s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:00:36 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Converted 1024.00 MB image at 172.63 MB/s Aug 24 10:00:36 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e is being set with open permissions: ugo+rw Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:36 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e Aug 24 10:00:36 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:36 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e" returned: 0 in 0.413s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-0c5da540-96af-43d5-b128-821a19b7b03e" released by "_copy_volume_from_snapshot" :: held 7.351s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-b2bae081-d424-42c3-a5b0-3e87370e6558-0c5da540-96af-43d5-b128-821a19b7b03e" released by "_create_volume_from_snapshot" :: held 7.430s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.456s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.629s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Creating offline snapshot 3f33f09d-a641-4e26-acbe-f29a2f3a6dbb of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d034697c-c855-4791-8409-227c836ec900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c5da540-96af-43d5-b128-821a19b7b03e', 'volume_size': 1, 'snapshot_id': 'b2bae081-d424-42c3-a5b0-3e87370e6558'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa04a69-af93-40d2-9760-edbaaae6a8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d9aa34-ecc9-44e7-a89c-6978f2e2849f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:37 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Volume volume-0c5da540-96af-43d5-b128-821a19b7b03e (0c5da540-96af-43d5-b128-821a19b7b03e): created successfully Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa04a69-af93-40d2-9760-edbaaae6a8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Flow 'volume_create_manager' (9de5301a-2588-42e2-aaac-f5e3a1de3b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:37 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-818ca3bb-1178-4dea-b2d3-95fce8d8edd4 tempest-VolumesDeleteCascade-102156288 None] Created volume successfully. Aug 24 10:00:37 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:37 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:37 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.542s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:37 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb 1G Aug 24 10:00:37 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-6d35fd43-235d-4435-8715-8d6f58006309-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-6d35fd43-235d-4435-8715-8d6f58006309-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Performing cascade delete. {{(pid=94039) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-b2bae081-d424-42c3-a5b0-3e87370e6558-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-b2bae081-d424-42c3-a5b0-3e87370e6558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-6d35fd43-235d-4435-8715-8d6f58006309" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-6d35fd43-235d-4435-8715-8d6f58006309" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-b2bae081-d424-42c3-a5b0-3e87370e6558" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-b2bae081-d424-42c3-a5b0-3e87370e6558" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Deleting offline snapshot b2bae081-d424-42c3-a5b0-3e87370e6558 of volume 6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] snapshot_file for this snap is: volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba193971-c1e9-4b44-a8a5-640ed16cfdff]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:38 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb 1G" returned: 0 in 0.694s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:38 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb Aug 24 10:00:38 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:38 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 Aug 24 10:00:38 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:38 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" returned: 0 in 0.392s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:38 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb is being set with open permissions: ugo+rw Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:38 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558" returned: 0 in 0.516s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d35fd43-235d-4435-8715-8d6f58006309(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:38 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb Aug 24 10:00:38 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccccad37-de6c-4aec-8018-09996b566026]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:38 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 Aug 24 10:00:38 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:39 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" returned: 0 in 0.416s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Flow 'volume_create_manager' (1546f89a-9023-4b50-b080-5709ac156bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47342aa-f02f-4b10-b221-13894ac40076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:39 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-51655ece-28d9-4063-8c83-6f1eb15f2071 tempest-SnapshotsActionsTest-1017097117 None] Create snapshot completed successfully Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47342aa-f02f-4b10-b221-13894ac40076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1694302617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52624d0d-441c-40ef-9d28-a9dfa9b984f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bad43498e6c4420b323c7c77cc0a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:39Z,use_quota=True,user_id='fdaff6aa1e0544a98bdee101b6cea5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fed0017-af6c-424e-9b64-054f21586e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fed0017-af6c-424e-9b64-054f21586e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699395d2-7421-4101-8206-9ce0b609b6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699395d2-7421-4101-8206-9ce0b609b6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52624d0d-441c-40ef-9d28-a9dfa9b984f9', 'volume_name': 'volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5a3af1-bc01-47ea-b7a7-642dd5d2357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5a3af1-bc01-47ea-b7a7-642dd5d2357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bb8c7d-804f-44d2-b2b8-4fcb99b8785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:39 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Volume 52624d0d-441c-40ef-9d28-a9dfa9b984f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9', 'volume_size': 1} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1694302617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52624d0d-441c-40ef-9d28-a9dfa9b984f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bad43498e6c4420b323c7c77cc0a789',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:39Z,use_quota=True,user_id='fdaff6aa1e0544a98bdee101b6cea5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Creating volume 52624d0d-441c-40ef-9d28-a9dfa9b984f9 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:39 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:39 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 1073741824 Aug 24 10:00:39 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:39 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309" returned: 0 in 0.729s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:39 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 Aug 24 10:00:39 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-3f33f09d-a641-4e26-acbe-f29a2f3a6dbb-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-3f33f09d-a641-4e26-acbe-f29a2f3a6dbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Deleting offline snapshot 3f33f09d-a641-4e26-acbe-f29a2f3a6dbb of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] snapshot_file for this snap is: volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23a182b-d11f-4386-b982-a2454603c398]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:39 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:39 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 1073741824" returned: 0 in 0.576s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558" returned: 0 in 0.427s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:39 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558 Aug 24 10:00:39 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:39 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb Aug 24 10:00:39 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:40 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 Aug 24 10:00:40 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "cinder-982532cb-20fb-4d73-9192-2f4fba28b045-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-982532cb-20fb-4d73-9192-2f4fba28b045-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "cinder-quobyte-982532cb-20fb-4d73-9192-2f4fba28b045" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:40 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" returned: 0 in 0.478s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-quobyte-982532cb-20fb-4d73-9192-2f4fba28b045" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:40 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:40 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4cfc43-aa90-4204-8f79-4594969c293c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b7256-1ce1-4e52-a8ef-278c39657471]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9" returned: 0 in 0.370s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309.b2bae081-d424-42c3-a5b0-3e87370e6558" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-b2bae081-d424-42c3-a5b0-3e87370e6558" released by "_delete_snapshot" :: held 2.246s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bb8c7d-804f-44d2-b2b8-4fcb99b8785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2a5d15-16cc-4472-a547-6183ba9a12ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-6d35fd43-235d-4435-8715-8d6f58006309" released by "delete_snapshot" :: held 2.288s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:40 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Volume volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 (52624d0d-441c-40ef-9d28-a9dfa9b984f9): created successfully Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2a5d15-16cc-4472-a547-6183ba9a12ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Flow 'volume_create_manager' (1546f89a-9023-4b50-b080-5709ac156bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:40 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 Aug 24 10:00:40 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:40 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:40 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-88316468-a972-443c-8ded-dc7a2ae0c106 tempest-AttachVolumeShelveTestJSON-1405631947 None] Created volume successfully. Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Created reservations ['42ec2246-0947-4500-b2c6-d1a83db51dcf', '010ef5ca-a4d5-44a3-94d4-3009ec6d5d5d', '70cde0d0-f3c3-4b77-8218-37f31b7adca5', '8aa1c6d1-58a4-4a96-bd70-b565c5d7ea4c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Delete snapshot completed successfully. Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-b2bae081-d424-42c3-a5b0-3e87370e6558-delete_snapshot" released by "delete_snapshot" :: held 2.512s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Snapshots deleted, issuing volume delete {{(pid=94039) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-6d35fd43-235d-4435-8715-8d6f58006309" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-6d35fd43-235d-4435-8715-8d6f58006309" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da3761-fa2e-4935-9978-6bb975d8f081]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:40 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:40 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb Aug 24 10:00:40 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:40 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045" returned: 0 in 0.500s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:40 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 Aug 24 10:00:40 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:40 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045 Aug 24 10:00:40 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:41 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-982532cb-20fb-4d73-9192-2f4fba28b045" returned: 0 in 0.263s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-quobyte-982532cb-20fb-4d73-9192-2f4fba28b045" released by "delete_volume" :: held 0.810s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:41 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309" returned: 0 in 0.450s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:41 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309 Aug 24 10:00:41 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Created reservations ['ec64fdf3-23a4-495f-89dd-14815046f243', '2a4e170f-d7a3-4175-999e-e8e08463ee71', '56a1bbf9-92f1-4344-8d8f-535500200ce7', 'ff93506a-fb0f-4adf-8ccc-38bbcf5636aa'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:41 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:41 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb Aug 24 10:00:41 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:41 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:41 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:41 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d35fd43-235d-4435-8715-8d6f58006309" returned: 0 in 0.361s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:41 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-6d35fd43-235d-4435-8715-8d6f58006309" released by "delete_volume" :: held 0.908s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "cinder-6424987a-de61-4117-9240-b727b9f94923-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-3f33f09d-a641-4e26-acbe-f29a2f3a6dbb" released by "_delete_snapshot" :: held 1.851s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" released by "delete_snapshot" :: held 1.900s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-6424987a-de61-4117-9240-b727b9f94923-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "cinder-quobyte-6424987a-de61-4117-9240-b727b9f94923" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:41 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Created reservations ['ad527840-ae31-45ac-b12b-7fb230831092', 'd469d695-51ae-4a66-bd6f-0d9f4c979807', '2e11e026-8cc2-4566-a2e1-188350b97f71', '0438fdb0-6a0a-46e3-846d-3ae6845f5c70'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.375s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-quobyte-6424987a-de61-4117-9240-b727b9f94923" acquired by "delete_volume" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:41 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Deleted volume successfully. Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8002e98-b746-4fb9-82f3-45b326a6a431]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ac00161e-ab18-4ff5-b2ab-404a48c515f8 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-982532cb-20fb-4d73-9192-2f4fba28b045-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Created reservations ['62b96903-98b8-402f-b84f-f316f4f5a2ec', '1fde8ef0-0a32-4dee-8a6e-14ede2a094d2', '15d8f5c0-c37e-46dc-9ea4-8c69948068af', '1b7924d5-026e-4766-8ebe-58edc4a45861'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:41 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 Aug 24 10:00:41 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:41 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:41 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:42 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Delete snapshot completed successfully. Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-318a5240-7f65-44e4-a0ad-85a232efe27b tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-3f33f09d-a641-4e26-acbe-f29a2f3a6dbb-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:42 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.289s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:42 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Deleted volume successfully. Aug 24 10:00:42 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d6fa32c-804a-4990-a619-e0c4b4784d02 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-6d35fd43-235d-4435-8715-8d6f58006309-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923" returned: 0 in 0.455s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:42 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923 Aug 24 10:00:42 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-0c5da540-96af-43d5-b128-821a19b7b03e-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:42 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6424987a-de61-4117-9240-b727b9f94923" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-quobyte-6424987a-de61-4117-9240-b727b9f94923" released by "delete_volume" :: held 0.844s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-0c5da540-96af-43d5-b128-821a19b7b03e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "cinder-quobyte-0c5da540-96af-43d5-b128-821a19b7b03e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-0c5da540-96af-43d5-b128-821a19b7b03e" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d14470-8c3b-475b-a12d-786c9012020c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Created reservations ['305c0ac2-08fd-48dc-b17e-0362eaecf201', '0a59a6f8-0220-4e93-a7a2-798313bff96c', '6186461a-1fa1-4b09-91ad-6726a0b63eaa', '94918dc2-2af0-413b-9c86-f64d6c9f23c9'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:43 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e Aug 24 10:00:43 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:43 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:43 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:43 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.327s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Deleted volume successfully. Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-91d367b1-8ec1-4506-b25f-f0112e08aea7 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-6424987a-de61-4117-9240-b727b9f94923-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:43 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e" returned: 0 in 0.735s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:43 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e Aug 24 10:00:43 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Creating offline snapshot 79b51731-24b5-4329-919d-c4e072e63b3c of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208bccb-e73a-49be-b234-6f29e0283a06]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:43 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:43 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:43 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0c5da540-96af-43d5-b128-821a19b7b03e" returned: 0 in 0.360s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-quobyte-0c5da540-96af-43d5-b128-821a19b7b03e" released by "delete_volume" :: held 1.179s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Created reservations ['e2329a22-0542-4e4c-ba3e-7bacabdb4d32', 'bace84bd-bb43-4509-8ba2-6a5c1bf9800d', 'f8905347-bf87-4110-9dfc-5d7013e3fb87', '1228918a-d80e-4b55-bb49-761b62baabaa'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:44 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.541s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:44 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:44 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:44 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c 1G Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "cinder-36a0660f-0d46-4d90-a231-8df636353104-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:44 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-36a0660f-0d46-4d90-a231-8df636353104-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "cinder-quobyte-36a0660f-0d46-4d90-a231-8df636353104" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-quobyte-36a0660f-0d46-4d90-a231-8df636353104" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffca899-cc50-4de7-b370-e6805829d777]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:44 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.350s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:44 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 Aug 24 10:00:44 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Deleted volume successfully. Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c44cede4-db17-419c-8020-fb4bc96423a2 tempest-VolumesDeleteCascade-102156288 None] Lock "cinder-0c5da540-96af-43d5-b128-821a19b7b03e-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:44 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c 1G" returned: 0 in 0.502s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:44 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c Aug 24 10:00:44 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:44 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104" returned: 0 in 0.546s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:44 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104 Aug 24 10:00:44 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:45 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c" returned: 0 in 0.413s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:45 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c is being set with open permissions: ugo+rw Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:45 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c Aug 24 10:00:45 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:45 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-36a0660f-0d46-4d90-a231-8df636353104" returned: 0 in 0.343s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-quobyte-36a0660f-0d46-4d90-a231-8df636353104" released by "delete_volume" :: held 0.957s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Created reservations ['23dd564f-9f4a-4aec-bd43-28f6dcb78477', '53d65ea4-3896-46c8-99b8-03594f32a01b', '9e352c46-ea13-462b-a8fa-be0cf38a1cd5', '3a31363b-a75a-468a-8ee0-c48632537140'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:45 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c" returned: 0 in 0.357s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=158,cinder:SELECT=121,cinder:INSERT=34,cinder:DELETE=12 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-47f94269-4366-4bf7-b190-8c34dd87d9b9 tempest-SnapshotsActionsTest-1017097117 None] Create snapshot completed successfully Aug 24 10:00:45 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:45 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-79b51731-24b5-4329-919d-c4e072e63b3c-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-79b51731-24b5-4329-919d-c4e072e63b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:45 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.340s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Deleted volume successfully. Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-79b51731-24b5-4329-919d-c4e072e63b3c" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-79b51731-24b5-4329-919d-c4e072e63b3c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Deleting offline snapshot 79b51731-24b5-4329-919d-c4e072e63b3c of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] snapshot_file for this snap is: volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5f63724d-f3cc-4e73-876c-b9d13a48d5b6 tempest-AttachVolumeNegativeTest-44824851 None] Lock "cinder-36a0660f-0d46-4d90-a231-8df636353104-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee0d37-a1c8-4b89-9eaf-4493135d35d0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:46 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c Aug 24 10:00:46 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:46 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:46 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79bf75e-3b1b-46e3-b94c-c9f852750f95]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:46 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:46 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:46 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.583s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:47 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c Aug 24 10:00:47 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:47 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c" returned: 0 in 0.573s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:47 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c Aug 24 10:00:47 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:47 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.79b51731-24b5-4329-919d-c4e072e63b3c" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-79b51731-24b5-4329-919d-c4e072e63b3c" released by "_delete_snapshot" :: held 2.136s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" released by "delete_snapshot" :: held 2.171s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:48 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Created reservations ['5844793d-411e-4478-a1b2-bba07d8624d9', '45de8750-7884-4707-90f0-20fd169fafca', '8c47196c-f4e0-4092-8b56-364155f6e1c5', '1e43546e-112c-4f43-9266-230a1ba9e56d'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Delete snapshot completed successfully. Aug 24 10:00:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02fb7761-1539-4b52-ae71-0d0abf03eea9 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-79b51731-24b5-4329-919d-c4e072e63b3c-delete_snapshot" released by "delete_snapshot" :: held 2.411s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Flow 'volume_create_manager' (713d186c-cc0b-4edb-81a1-a9a421482d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d8dd11-632c-4eda-ab86-ea0e18ab5680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d8dd11-632c-4eda-ab86-ea0e18ab5680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-108569740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e5f816-ea2d-4aa7-be50-c85b911608e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5221ba513c084f509e5e6ae08e25b127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:49Z,use_quota=True,user_id='d2dcd7344c974c00aa9b88d41c35d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c69799-116a-471b-ab33-95932eb3c431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c69799-116a-471b-ab33-95932eb3c431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee66705-1822-4ae7-96eb-b4b4f7a77574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee66705-1822-4ae7-96eb-b4b4f7a77574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e5f816-ea2d-4aa7-be50-c85b911608e7', 'volume_name': 'volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ccf771b-8c21-410d-a929-e28a18aa01e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ccf771b-8c21-410d-a929-e28a18aa01e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dc92e7-f6f4-41de-864b-4b276c9f88d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:49 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Volume f5e5f816-ea2d-4aa7-be50-c85b911608e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7', 'volume_size': 1} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-108569740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e5f816-ea2d-4aa7-be50-c85b911608e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5221ba513c084f509e5e6ae08e25b127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:00:49Z,use_quota=True,user_id='d2dcd7344c974c00aa9b88d41c35d924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Creating volume f5e5f816-ea2d-4aa7-be50-c85b911608e7 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:00:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:49 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 1073741824 Aug 24 10:00:49 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:49 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 1073741824" returned: 0 in 0.572s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:49 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 Aug 24 10:00:49 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:50 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7" returned: 0 in 0.532s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.948s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Creating offline snapshot a4106b19-763e-4970-814c-dcbfe92485f3 of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dc92e7-f6f4-41de-864b-4b276c9f88d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5ec995-bdc9-4cda-8ca2-cd2b9fff7e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1dae5a-eeae-4185-a6a7-7852781bad69]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:50 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Volume volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 (f5e5f816-ea2d-4aa7-be50-c85b911608e7): created successfully Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5ec995-bdc9-4cda-8ca2-cd2b9fff7e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Flow 'volume_create_manager' (713d186c-cc0b-4edb-81a1-a9a421482d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:00:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-013e5483-4a01-40b6-a0af-238ae284c0fa tempest-VolumesMetadataTest-1962499013 None] Created volume successfully. Aug 24 10:00:50 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:50 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:50 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.389s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:50 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 1G Aug 24 10:00:50 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:51 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 1G" returned: 0 in 0.655s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:51 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 Aug 24 10:00:51 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:52 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3" returned: 0 in 0.453s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:52 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 is being set with open permissions: ugo+rw Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:52 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 Aug 24 10:00:52 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:52 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3" returned: 0 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9f2b90cc-522a-4949-a8c1-e7ebba04b4d2 tempest-SnapshotsActionsTest-1017097117 None] Create snapshot completed successfully Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Acquiring lock "cinder-f5e5f816-ea2d-4aa7-be50-c85b911608e7-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Lock "cinder-f5e5f816-ea2d-4aa7-be50-c85b911608e7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Acquiring lock "cinder-quobyte-f5e5f816-ea2d-4aa7-be50-c85b911608e7" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Lock "cinder-quobyte-f5e5f816-ea2d-4aa7-be50-c85b911608e7" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e137b-65a5-4462-a7fd-37b8a2d22c99]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-3729f5a4-abc7-4b8e-9def-d3866ba10cee req-b65e9231-082a-4c4e-8830-0b082c85e1e4 tempest-AttachVolumeShelveTestJSON-1405631947 None] No connector for attachment 7c9a12de-2da8-4a8b-84ec-c83486a971ff; skipping storage backend terminate_connection call. {{(pid=94039) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 24 10:00:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-3729f5a4-abc7-4b8e-9def-d3866ba10cee req-b65e9231-082a-4c4e-8830-0b082c85e1e4 tempest-AttachVolumeShelveTestJSON-1405631947 None] Deleting attachment 7c9a12de-2da8-4a8b-84ec-c83486a971ff. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:00:52 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 Aug 24 10:00:52 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-a4106b19-763e-4970-814c-dcbfe92485f3-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-a4106b19-763e-4970-814c-dcbfe92485f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Acquiring lock "cinder-quobyte-a4106b19-763e-4970-814c-dcbfe92485f3" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-a4106b19-763e-4970-814c-dcbfe92485f3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Deleting offline snapshot a4106b19-763e-4970-814c-dcbfe92485f3 of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] snapshot_file for this snap is: volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c621bb1-e68d-4a95-bd57-2dc264271b53]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:53 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7" returned: 0 in 0.480s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:53 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7 Aug 24 10:00:53 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:53 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 Aug 24 10:00:53 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:53 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f5e5f816-ea2d-4aa7-be50-c85b911608e7" returned: 0 in 0.374s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Lock "cinder-quobyte-f5e5f816-ea2d-4aa7-be50-c85b911608e7" released by "delete_volume" :: held 0.937s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:53 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3" returned: 0 in 0.590s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Created reservations ['9742859b-9647-4927-9094-df230edf8e2c', '955ac60b-619a-42bf-afab-e8eb7ac5382d', '2c161826-dfd7-4425-a080-9baf4cb8943f', 'd203e48f-b51b-4359-8bda-098380ece75f'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[73905044-7009-4d27-8169-d6a21b69a34a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:54 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:00:54 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:54 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:54 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:54 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.298s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:00:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Deleted volume successfully. Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ee72352e-544f-453c-93ad-6746749659a3 tempest-VolumesMetadataTest-1962499013 None] Lock "cinder-f5e5f816-ea2d-4aa7-be50-c85b911608e7-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:54 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.598s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:54 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 Aug 24 10:00:54 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:55 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3" returned: 0 in 0.536s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:55 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3 Aug 24 10:00:55 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:55 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.a4106b19-763e-4970-814c-dcbfe92485f3" returned: 0 in 0.401s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-a4106b19-763e-4970-814c-dcbfe92485f3" released by "_delete_snapshot" :: held 2.306s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" released by "delete_snapshot" :: held 2.346s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Created reservations ['3370e289-5aa1-48a4-bd94-609f80e2833a', 'bb57e2fd-72fa-4555-b98b-e2ef79a1ca6f', '019c27cd-e577-4667-9869-7252af1ce439', 'b2c69f04-8e2a-4453-a2a9-9b8318953a03'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Delete snapshot completed successfully. Aug 24 10:00:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bc884233-6231-4e8d-9eaa-4e26f0f3c104 tempest-SnapshotsActionsTest-1039616423 None] Lock "cinder-a4106b19-763e-4970-814c-dcbfe92485f3-delete_snapshot" released by "delete_snapshot" :: held 2.591s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "cinder-fdc188f4-9222-4851-a86f-feadd9d3d50c-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-fdc188f4-9222-4851-a86f-feadd9d3d50c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "cinder-quobyte-fdc188f4-9222-4851-a86f-feadd9d3d50c" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-quobyte-fdc188f4-9222-4851-a86f-feadd9d3d50c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Deleting offline snapshot fdc188f4-9222-4851-a86f-feadd9d3d50c of volume d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] snapshot_file for this snap is: volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a75d0a-39fd-4925-87c4-e75e0458e285]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:57 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:57 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:57 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.428s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0052cb-758b-41c1-a43f-7e6c7ac4dae1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:00:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:57 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 Aug 24 10:00:57 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:58 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" returned: 0 in 0.650s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:58 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:58 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:58 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.715s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:00:59 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c Aug 24 10:00:59 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:00:59 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Aug 24 10:00:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8.fdc188f4-9222-4851-a86f-feadd9d3d50c" returned: 0 in 0.361s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:00:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-quobyte-fdc188f4-9222-4851-a86f-feadd9d3d50c" released by "_delete_snapshot" :: held 2.331s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" released by "delete_snapshot" :: held 2.370s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:00:59 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Created reservations ['a08161bf-18cd-4c0d-ae1e-b6e63a1c1ed7', 'b260035b-8b16-4532-b6b8-8e538f0e38ce', '2ddf78c4-668e-4497-ba59-61cdfa37e312', '8781cbfd-23e4-4cc6-ae7a-03f38189baeb'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:00:59 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Delete snapshot completed successfully. Aug 24 10:00:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7019393c-027c-45d3-83b2-b260b51e81b7 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-fdc188f4-9222-4851-a86f-feadd9d3d50c-delete_snapshot" released by "delete_snapshot" :: held 2.576s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "cinder-d348d92e-e0d7-4173-b6c3-6fe9129ffca8-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-d348d92e-e0d7-4173-b6c3-6fe9129ffca8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e3a868-c3ae-43c6-84f6-1356a08494b8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:00 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 Aug 24 10:01:00 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:01 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" returned: 0 in 0.571s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:01 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8 Aug 24 10:01:01 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:01 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-quobyte-d348d92e-e0d7-4173-b6c3-6fe9129ffca8" released by "delete_volume" :: held 1.095s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Created reservations ['a91bb592-0232-4c2a-ae25-a639f3bf1b2c', '5fbf0875-2412-45c6-9f4c-5aec41eef9f2', '7acdd857-0abe-4aba-8e42-5700538f8410', '8e3cf944-e5ff-40b8-bbdd-2551208855ee'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:01 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:01 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Flow 'volume_create_manager' (30fd04bb-6f3f-4040-a2df-3bbe9f825421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5049f2-a95a-4ef8-ab5c-cc2c9ce7fce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5049f2-a95a-4ef8-ab5c-cc2c9ce7fce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1914171796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7087177c-028c-4347-9056-1316218a6266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065f44f437ce4eb9b01ed59a60d9b0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:02Z,use_quota=True,user_id='ca43120261714f77a969df45a0653666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e12ee80-bab2-45a4-9f62-b63222eda17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e12ee80-bab2-45a4-9f62-b63222eda17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34c5e74-19ee-4962-b1bc-dd8adf4c4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34c5e74-19ee-4962-b1bc-dd8adf4c4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7087177c-028c-4347-9056-1316218a6266', 'volume_name': 'volume-7087177c-028c-4347-9056-1316218a6266', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ef1d18-26b6-4ada-911c-cf2a2740fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ef1d18-26b6-4ada-911c-cf2a2740fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8769c9-141b-4734-9422-3bc1dc929e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Volume 7087177c-028c-4347-9056-1316218a6266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7087177c-028c-4347-9056-1316218a6266', 'volume_size': 1} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1914171796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7087177c-028c-4347-9056-1316218a6266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065f44f437ce4eb9b01ed59a60d9b0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:02Z,use_quota=True,user_id='ca43120261714f77a969df45a0653666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Creating volume 7087177c-028c-4347-9056-1316218a6266 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:02 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:02 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Deleted volume successfully. Aug 24 10:01:02 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 1073741824 Aug 24 10:01:02 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-63173ae3-76bd-4d71-9c24-2c9d08c5d4e6 tempest-SnapshotsActionsTest-1017097117 None] Lock "cinder-d348d92e-e0d7-4173-b6c3-6fe9129ffca8-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:02 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 1073741824" returned: 0 in 0.620s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:02 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 Aug 24 10:01:02 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:03 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266" returned: 0 in 0.341s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8769c9-141b-4734-9422-3bc1dc929e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7087177c-028c-4347-9056-1316218a6266', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6481845a-513a-4046-bb3f-0e5f765bbefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Volume volume-7087177c-028c-4347-9056-1316218a6266 (7087177c-028c-4347-9056-1316218a6266): created successfully Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6481845a-513a-4046-bb3f-0e5f765bbefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Flow 'volume_create_manager' (30fd04bb-6f3f-4040-a2df-3bbe9f825421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1cbb5e00-7f61-4e92-9afe-2a6ee8a9ee4b tempest-VolumesTransfersV355Test-966976150 None] Created volume successfully. Aug 24 10:01:05 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=147,cinder:SELECT=145,cinder:INSERT=39,cinder:DELETE=14 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:01:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fe94bb08-8ca8-4c27-8aec-789d79640c97 tempest-VolumesTransfersV355Test-762601556 None] Transfer volume completed successfully. Aug 24 10:01:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Acquiring lock "cinder-7087177c-028c-4347-9056-1316218a6266-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-7087177c-028c-4347-9056-1316218a6266-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Acquiring lock "cinder-quobyte-7087177c-028c-4347-9056-1316218a6266" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-quobyte-7087177c-028c-4347-9056-1316218a6266" acquired by "delete_volume" :: waited 0.042s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed2981-87de-4b16-834c-846fbf925def]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:07 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 Aug 24 10:01:07 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:08 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266" returned: 0 in 0.812s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:08 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266 Aug 24 10:01:08 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:08 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7087177c-028c-4347-9056-1316218a6266" returned: 0 in 0.594s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-quobyte-7087177c-028c-4347-9056-1316218a6266" released by "delete_volume" :: held 1.536s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Created reservations ['1023cdba-aa93-4fcc-b41a-04f39683580b', '3ce99a23-8469-4e75-b1d9-61d064a4b916', '9e8793e1-71ae-42fb-ae0e-c3d59d591a5d', '21031495-36fc-4d5c-9d90-a79e7e57db4c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:08 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:08 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:09 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.436s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:09 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Deleted volume successfully. Aug 24 10:01:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-61d0e551-05f2-4606-9c1d-ffe768601282 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-7087177c-028c-4347-9056-1316218a6266-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Flow 'volume_create_manager' (e416d8cd-aa2f-464a-bf59-1b9e7f4d06ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f78ac3b-5ff1-4714-bb7d-2f7253899df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f78ac3b-5ff1-4714-bb7d-2f7253899df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1545892758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fd3879-7a51-4573-aeab-9a64358f5612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065f44f437ce4eb9b01ed59a60d9b0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:10Z,use_quota=True,user_id='ca43120261714f77a969df45a0653666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586cd93d-0c97-4979-9847-72f1bd773a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586cd93d-0c97-4979-9847-72f1bd773a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666ae58b-ce47-4369-b03b-050ce1954f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666ae58b-ce47-4369-b03b-050ce1954f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60fd3879-7a51-4573-aeab-9a64358f5612', 'volume_name': 'volume-60fd3879-7a51-4573-aeab-9a64358f5612', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262f4dad-2433-433a-84e5-984da8d20a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262f4dad-2433-433a-84e5-984da8d20a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ee9318-c4ce-4cff-8fd3-74525deb8a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Volume 60fd3879-7a51-4573-aeab-9a64358f5612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60fd3879-7a51-4573-aeab-9a64358f5612', 'volume_size': 1} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1545892758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60fd3879-7a51-4573-aeab-9a64358f5612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='065f44f437ce4eb9b01ed59a60d9b0d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:10Z,use_quota=True,user_id='ca43120261714f77a969df45a0653666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Creating volume 60fd3879-7a51-4573-aeab-9a64358f5612 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:10 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:10 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 1073741824 Aug 24 10:01:10 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 1073741824" returned: 0 in 0.545s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:10 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:11 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 Aug 24 10:01:11 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:11 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612" returned: 0 in 0.340s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ee9318-c4ce-4cff-8fd3-74525deb8a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60fd3879-7a51-4573-aeab-9a64358f5612', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ba7ae2-7818-4e45-a4ac-af5abd841683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Volume volume-60fd3879-7a51-4573-aeab-9a64358f5612 (60fd3879-7a51-4573-aeab-9a64358f5612): created successfully Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ba7ae2-7818-4e45-a4ac-af5abd841683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Flow 'volume_create_manager' (e416d8cd-aa2f-464a-bf59-1b9e7f4d06ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4c390683-f73c-4a82-b95d-8d5990c4c6e2 tempest-VolumesTransfersV355Test-966976150 None] Created volume successfully. Aug 24 10:01:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d6b93eae-31e9-4be0-80cf-e47bcd937bbb tempest-GroupsTest-1831008328 None] Group tempest-Group1-1446919328: creating Aug 24 10:01:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d6b93eae-31e9-4be0-80cf-e47bcd937bbb tempest-GroupsTest-1831008328 None] Group tempest-Group1-1446919328: created successfully Aug 24 10:01:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d6b93eae-31e9-4be0-80cf-e47bcd937bbb tempest-GroupsTest-1831008328 None] Create group completed successfully. Aug 24 10:01:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Acquiring lock "cinder-60fd3879-7a51-4573-aeab-9a64358f5612-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-60fd3879-7a51-4573-aeab-9a64358f5612-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Acquiring lock "cinder-quobyte-60fd3879-7a51-4573-aeab-9a64358f5612" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-quobyte-60fd3879-7a51-4573-aeab-9a64358f5612" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d395a4c1-d564-4b3d-8ff7-ba8d67e7159c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:13 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 Aug 24 10:01:13 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:13 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612" returned: 0 in 0.396s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:13 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612 Aug 24 10:01:13 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:13 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-60fd3879-7a51-4573-aeab-9a64358f5612" returned: 0 in 0.270s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-quobyte-60fd3879-7a51-4573-aeab-9a64358f5612" released by "delete_volume" :: held 0.725s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Created reservations ['838be31f-2c60-4721-a361-f664a15b98d7', 'e19ae5ba-5525-4670-bdff-f66f4c7a3710', '8d5cb154-554d-47d5-8866-3b0fd26e7acc', '9c853b2e-8406-4111-bae6-9c6e144235de'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:14 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:14 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-49c2ccc3-c5a7-428f-b34c-2e6de9678e12 tempest-GroupsTest-1831008328 None] Group tempest-Group2-842598074: creating Aug 24 10:01:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-49c2ccc3-c5a7-428f-b34c-2e6de9678e12 tempest-GroupsTest-1831008328 None] Group tempest-Group2-842598074: created successfully Aug 24 10:01:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-49c2ccc3-c5a7-428f-b34c-2e6de9678e12 tempest-GroupsTest-1831008328 None] Create group completed successfully. Aug 24 10:01:14 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.306s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:14 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Deleted volume successfully. Aug 24 10:01:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6d67ade4-8e87-41a4-99e7-e950f3850534 tempest-VolumesTransfersV355Test-1807442533 None] Lock "cinder-60fd3879-7a51-4573-aeab-9a64358f5612-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Flow 'volume_create_manager' (19861b80-8094-42f1-a2d3-cdef53d7c860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5017896c-8fb6-4d2f-89cd-1f5474639f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5017896c-8fb6-4d2f-89cd-1f5474639f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933555760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51bb531f-bd28-42a9-b1fe-5ba6188b4f1d,host='devstack@QuobyteHD#QuobyteHD',id=9218165f-2aeb-457b-907a-09d884e0fd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff50dfa1c94d34bc2a09dc403bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:16Z,use_quota=True,user_id='910e5e1ed87540a382a4624b492059a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787ad952-55e1-401e-933e-596579d17307),volume_type_id=787ad952-55e1-401e-933e-596579d17307)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426c03af-e5d7-4e0a-8e27-33e1602a6a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426c03af-e5d7-4e0a-8e27-33e1602a6a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972944b2-ad9d-4c1a-bff4-fa27beedcee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972944b2-ad9d-4c1a-bff4-fa27beedcee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9218165f-2aeb-457b-907a-09d884e0fd2c', 'volume_name': 'volume-9218165f-2aeb-457b-907a-09d884e0fd2c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1bebee-3b5e-438d-a0a2-1ab5e032d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1bebee-3b5e-438d-a0a2-1ab5e032d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561251ea-0b0b-4b00-9d50-ccf695bd75b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Volume 9218165f-2aeb-457b-907a-09d884e0fd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9218165f-2aeb-457b-907a-09d884e0fd2c', 'volume_size': 1} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=51bb531f-bd28-42a9-b1fe-5ba6188b4f1d,created_at=2026-08-24T08:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1933555760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=51bb531f-bd28-42a9-b1fe-5ba6188b4f1d,host='devstack@QuobyteHD#QuobyteHD',id=9218165f-2aeb-457b-907a-09d884e0fd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff50dfa1c94d34bc2a09dc403bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:16Z,use_quota=True,user_id='910e5e1ed87540a382a4624b492059a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787ad952-55e1-401e-933e-596579d17307),volume_type_id=787ad952-55e1-401e-933e-596579d17307)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Creating volume 9218165f-2aeb-457b-907a-09d884e0fd2c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:16 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:16 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c 1073741824 Aug 24 10:01:16 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:16 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c 1073741824" returned: 0 in 0.561s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:16 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c Aug 24 10:01:16 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:17 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c" returned: 0 in 0.467s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561251ea-0b0b-4b00-9d50-ccf695bd75b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9218165f-2aeb-457b-907a-09d884e0fd2c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924eaa3f-54b9-458c-84a2-20640dcdbcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:17 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Volume volume-9218165f-2aeb-457b-907a-09d884e0fd2c (9218165f-2aeb-457b-907a-09d884e0fd2c): created successfully Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924eaa3f-54b9-458c-84a2-20640dcdbcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Flow 'volume_create_manager' (19861b80-8094-42f1-a2d3-cdef53d7c860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f30c8132-a6ef-4018-84fb-49795522d5d7 tempest-GroupsTest-1831008328 None] Created volume successfully. Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Flow 'volume_create_manager' (48d7f054-a327-4db3-ae72-db3ec517711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e484047a-f28f-4dde-abd4-c410bd4f081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e484047a-f28f-4dde-abd4-c410bd4f081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2004534543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657ddf1d-bad6-404a-8b18-dd5bdcacdc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1c5556a4ad4ea4b41791211922ec33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:18Z,use_quota=True,user_id='e6984448213445c392e72c4acadb7676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9b6208-b64a-479f-93d8-d98a740ccadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9b6208-b64a-479f-93d8-d98a740ccadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebb9ace-ca41-4670-ae21-c9d55a04ea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebb9ace-ca41-4670-ae21-c9d55a04ea98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657ddf1d-bad6-404a-8b18-dd5bdcacdc80', 'volume_name': 'volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17489b5d-7bc8-4c25-83ba-807de6621ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17489b5d-7bc8-4c25-83ba-807de6621ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a724365-18de-4c74-b8d6-b66b8263297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:18 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Volume 657ddf1d-bad6-404a-8b18-dd5bdcacdc80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80', 'volume_size': 1} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2004534543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657ddf1d-bad6-404a-8b18-dd5bdcacdc80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1c5556a4ad4ea4b41791211922ec33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:18Z,use_quota=True,user_id='e6984448213445c392e72c4acadb7676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Creating volume 657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:18 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:18 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 1073741824 Aug 24 10:01:18 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:19 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 1073741824" returned: 0 in 0.712s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:19 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 Aug 24 10:01:19 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Acquiring lock "cinder-quobyte-9218165f-2aeb-457b-907a-09d884e0fd2c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Lock "cinder-quobyte-9218165f-2aeb-457b-907a-09d884e0fd2c" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c795813b-be00-45a9-84af-f54e1974b1e5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:19 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" returned: 0 in 0.395s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a724365-18de-4c74-b8d6-b66b8263297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8af7d5-2761-46f9-aa3d-83cb8aa640ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Volume volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 (657ddf1d-bad6-404a-8b18-dd5bdcacdc80): created successfully Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8af7d5-2761-46f9-aa3d-83cb8aa640ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Flow 'volume_create_manager' (48d7f054-a327-4db3-ae72-db3ec517711c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-61354244-6c31-472d-b11a-492e7fcba69b tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Created volume successfully. Aug 24 10:01:19 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c Aug 24 10:01:19 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:20 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:20 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c Aug 24 10:01:20 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:20 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9218165f-2aeb-457b-907a-09d884e0fd2c" returned: 0 in 0.238s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Lock "cinder-quobyte-9218165f-2aeb-457b-907a-09d884e0fd2c" released by "delete_volume" :: held 0.758s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Created reservations ['eedeaabc-ceef-45bd-ac4f-720172ca3895'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:20 devstack cinder-volume[94039]: WARNING cinder.quota [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1101891113 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1101891113, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:01:20 devstack cinder-volume[94039]: WARNING cinder.quota [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1101891113 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1101891113, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Created reservations ['1ff5678f-4647-4f57-9c63-f9c0bb85d7a8', '2bc523b9-f2bb-498b-9bcc-16aa895ede29', '2b099a2a-1974-481f-86c4-d4643d3248b9', '7807a2ab-aa57-4514-8095-33219b59af9d'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:20 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:20 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Creating offline snapshot 9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 of volume 657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[510a313e-7422-4d15-8e54-6377d1b9ca00]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:20 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 Aug 24 10:01:20 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:21 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-836a2960-8a06-44e4-bcff-274127595c88 tempest-GroupsTest-1831008328 None] Delete group completed successfully. Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Created reservations ['0301dbc1-c25c-4e6f-b537-8f8eee259b06'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:21 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:21 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:21 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" returned: 0 in 0.439s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:21 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 1G Aug 24 10:01:21 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:21 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.292s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-28b1baf3-46dd-4761-965b-25e4eb41ffda tempest-GroupsTest-1831008328 None] Delete group completed successfully. Aug 24 10:01:21 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 1G" returned: 0 in 0.471s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:21 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 Aug 24 10:01:21 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:22 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" returned: 0 in 0.345s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:22 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 is being set with open permissions: ugo+rw Aug 24 10:01:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:22 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 Aug 24 10:01:22 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:22 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" returned: 0 in 0.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:22 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info Aug 24 10:01:22 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:22 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:22 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info is being set with open permissions: ugo+rw Aug 24 10:01:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:22 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info Aug 24 10:01:22 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a412c5d3-f5a6-4a33-a185-e1b83b2f7542 tempest-GroupsTest-1831008328 None] Group tempest-GroupsTest-Group-988416843: creating Aug 24 10:01:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a412c5d3-f5a6-4a33-a185-e1b83b2f7542 tempest-GroupsTest-1831008328 None] Group tempest-GroupsTest-Group-988416843: created successfully Aug 24 10:01:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a412c5d3-f5a6-4a33-a185-e1b83b2f7542 tempest-GroupsTest-1831008328 None] Create group completed successfully. Aug 24 10:01:23 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.info" returned: 0 in 0.289s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.230s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2060d084-c782-4073-9df2-9d470f95043f tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Create snapshot completed successfully Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "cinder-9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "cinder-quobyte-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-quobyte-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "cinder-quobyte-9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-quobyte-9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Deleting offline snapshot 9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 of volume 657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] snapshot_file for this snap is: volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aaeff6-d298-4a36-b46a-1e269a551062]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Flow 'volume_create_manager' (227766cc-06b8-4a11-ba2a-4900ef5529d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee07d3ea-8f43-41d0-9e10-2a0f93aea1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee07d3ea-8f43-41d0-9e10-2a0f93aea1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-627456906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e603752-eccb-4b01-a83e-2e7252e3b1c8,host='devstack@QuobyteHD#QuobyteHD',id=046e34a9-b8ff-4987-b76f-9e09bdda07b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff50dfa1c94d34bc2a09dc403bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:25Z,use_quota=True,user_id='910e5e1ed87540a382a4624b492059a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(823440b5-3be5-42c2-b29c-67623b9e9510),volume_type_id=823440b5-3be5-42c2-b29c-67623b9e9510)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83600f3-af50-4980-8417-57f36d335908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83600f3-af50-4980-8417-57f36d335908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef868ab2-ff66-4f6d-94a6-7861221fab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef868ab2-ff66-4f6d-94a6-7861221fab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046e34a9-b8ff-4987-b76f-9e09bdda07b9', 'volume_name': 'volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e0065b-53a3-4278-b829-c8cd905b54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e0065b-53a3-4278-b829-c8cd905b54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b70c4a-a5d3-48b2-b1ee-e9b96b84e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Volume 046e34a9-b8ff-4987-b76f-9e09bdda07b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9', 'volume_size': 1} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e603752-eccb-4b01-a83e-2e7252e3b1c8,created_at=2026-08-24T08:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-627456906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e603752-eccb-4b01-a83e-2e7252e3b1c8,host='devstack@QuobyteHD#QuobyteHD',id=046e34a9-b8ff-4987-b76f-9e09bdda07b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff50dfa1c94d34bc2a09dc403bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:25Z,use_quota=True,user_id='910e5e1ed87540a382a4624b492059a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(823440b5-3be5-42c2-b29c-67623b9e9510),volume_type_id=823440b5-3be5-42c2-b29c-67623b9e9510)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Creating volume 046e34a9-b8ff-4987-b76f-9e09bdda07b9 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:24 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:24 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 Aug 24 10:01:24 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:24 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 1073741824 Aug 24 10:01:24 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:24 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" returned: 0 in 0.399s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b65fdc-2eb7-4a02-9eb5-86cc1959c886]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:25 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 Aug 24 10:01:25 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:25 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 1073741824" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:25 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 Aug 24 10:01:25 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:25 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" returned: 0 in 0.411s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:25 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 Aug 24 10:01:25 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:25 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b70c4a-a5d3-48b2-b1ee-e9b96b84e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891babff-ea8b-421c-ae26-43c74e379cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Volume volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 (046e34a9-b8ff-4987-b76f-9e09bdda07b9): created successfully Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891babff-ea8b-421c-ae26-43c74e379cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Flow 'volume_create_manager' (227766cc-06b8-4a11-ba2a-4900ef5529d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9d113c8a-f12f-4932-859d-b1d2270e577a tempest-GroupsTest-1831008328 None] Created volume successfully. Aug 24 10:01:26 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" returned: 0 in 0.649s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:26 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6 Aug 24 10:01:26 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:26 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:26 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:26 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80.9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" returned: 0 in 0.395s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-quobyte-9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6" released by "_delete_snapshot" :: held 2.036s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-quobyte-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" released by "delete_snapshot" :: held 2.067s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:26 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.421s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Created reservations ['9df062f5-7faf-413a-8e76-2e36057ff3c5', 'd36a1ce0-68c4-43f6-93fe-4ab320589811', '391141f4-4dc5-4e07-bbac-ed9552ee0d6c', '9a213d69-bbac-41c4-a312-6751c846e0bd'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Delete snapshot completed successfully. Aug 24 10:01:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-35807b85-1524-4a6b-9a26-426e8ca22e13 tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-9d602f1e-4ce6-4ca2-9e40-9a05c4f02ff6-delete_snapshot" released by "delete_snapshot" :: held 2.384s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "cinder-657ddf1d-bad6-404a-8b18-dd5bdcacdc80-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:27 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Flow 'volume_create_manager' (41083e63-00d6-4d93-b1bd-b8de77354f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa04e466-649e-40f4-816a-89e24fb401e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-657ddf1d-bad6-404a-8b18-dd5bdcacdc80-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa04e466-649e-40f4-816a-89e24fb401e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-340972757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e603752-eccb-4b01-a83e-2e7252e3b1c8,host='devstack@QuobyteHD#QuobyteHD',id=cad4273a-26df-4a06-ac14-9187d29311ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff50dfa1c94d34bc2a09dc403bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:28Z,use_quota=True,user_id='910e5e1ed87540a382a4624b492059a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(823440b5-3be5-42c2-b29c-67623b9e9510),volume_type_id=823440b5-3be5-42c2-b29c-67623b9e9510)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6c8ac0-3bb3-4d7e-9bcb-7b5a95e7cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6c8ac0-3bb3-4d7e-9bcb-7b5a95e7cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b72de18-d0ae-45ce-a6d5-5b4885dfb0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b72de18-d0ae-45ce-a6d5-5b4885dfb0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad4273a-26df-4a06-ac14-9187d29311ad', 'volume_name': 'volume-cad4273a-26df-4a06-ac14-9187d29311ad', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe69acf-dc27-4dfe-86be-27e3fec35ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe69acf-dc27-4dfe-86be-27e3fec35ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4711f368-c1de-47d5-add8-e4305d2f968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:28 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Volume cad4273a-26df-4a06-ac14-9187d29311ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad4273a-26df-4a06-ac14-9187d29311ad', 'volume_size': 1} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e603752-eccb-4b01-a83e-2e7252e3b1c8,created_at=2026-08-24T08:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-340972757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e603752-eccb-4b01-a83e-2e7252e3b1c8,host='devstack@QuobyteHD#QuobyteHD',id=cad4273a-26df-4a06-ac14-9187d29311ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff50dfa1c94d34bc2a09dc403bed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:28Z,use_quota=True,user_id='910e5e1ed87540a382a4624b492059a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(823440b5-3be5-42c2-b29c-67623b9e9510),volume_type_id=823440b5-3be5-42c2-b29c-67623b9e9510)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Creating volume cad4273a-26df-4a06-ac14-9187d29311ad {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:28 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:28 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad 1073741824 Aug 24 10:01:28 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "cinder-quobyte-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-quobyte-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" acquired by "delete_volume" :: waited 0.048s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0523fcad-6e63-42ff-a58e-73f6923669f8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:28 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 Aug 24 10:01:28 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:28 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad 1073741824" returned: 0 in 0.853s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:28 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" returned: 0 in 0.666s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:29 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80 Aug 24 10:01:29 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:29 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad Aug 24 10:01:29 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:29 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad" returned: 0 in 0.318s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4711f368-c1de-47d5-add8-e4305d2f968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad4273a-26df-4a06-ac14-9187d29311ad', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68ba129-b0fa-432c-bf77-f86114e4e094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:29 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Volume volume-cad4273a-26df-4a06-ac14-9187d29311ad (cad4273a-26df-4a06-ac14-9187d29311ad): created successfully Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68ba129-b0fa-432c-bf77-f86114e4e094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:29 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Flow 'volume_create_manager' (41083e63-00d6-4d93-b1bd-b8de77354f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" returned: 0 in 0.501s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5e1e4e11-d777-459b-aac6-b1980805279c tempest-GroupsTest-1831008328 None] Created volume successfully. Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-quobyte-657ddf1d-bad6-404a-8b18-dd5bdcacdc80" released by "delete_volume" :: held 1.279s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Created reservations ['b9a303f3-c900-4eb1-b2cd-823ed35ac04d', '14ef2ad7-347b-4b00-affd-a9c45da545f1', '8579b18a-f9cc-49ba-bbc5-c4addb57fa5f', '5f6d1063-c37b-4496-af8d-40c5711315fd'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:29 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:29 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:30 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.294s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:30 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Deleted volume successfully. Aug 24 10:01:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad116d41-e426-4853-aa0c-c6901eea15ef tempest-VolumeSnapshotQuotasNegativeTestJSON-825109138 None] Lock "cinder-657ddf1d-bad6-404a-8b18-dd5bdcacdc80-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1abe4aa9-9560-4525-b1d0-8f34ee62daac tempest-GroupsTest-1831008328 None] Update group completed successfully. Aug 24 10:01:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1e4d22bb-c4c5-42ea-a30b-7adda4213292 tempest-GroupsTest-1831008328 None] Update group completed successfully. Aug 24 10:01:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Acquiring lock "cinder-quobyte-046e34a9-b8ff-4987-b76f-9e09bdda07b9" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Lock "cinder-quobyte-046e34a9-b8ff-4987-b76f-9e09bdda07b9" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:34 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[573b1317-b086-4b08-9d9f-7f3de4b26027]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:34 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 Aug 24 10:01:34 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:34 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:34 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9 Aug 24 10:01:34 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:35 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-046e34a9-b8ff-4987-b76f-9e09bdda07b9" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Lock "cinder-quobyte-046e34a9-b8ff-4987-b76f-9e09bdda07b9" released by "delete_volume" :: held 1.006s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Acquiring lock "cinder-quobyte-cad4273a-26df-4a06-ac14-9187d29311ad" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Lock "cinder-quobyte-cad4273a-26df-4a06-ac14-9187d29311ad" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[199956eb-0344-4c18-8288-f848ed919b5d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:35 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad Aug 24 10:01:35 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:35 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad" returned: 0 in 0.667s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:36 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad Aug 24 10:01:36 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:36 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cad4273a-26df-4a06-ac14-9187d29311ad" returned: 0 in 0.326s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Lock "cinder-quobyte-cad4273a-26df-4a06-ac14-9187d29311ad" released by "delete_volume" :: held 1.064s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Created reservations ['d716ec97-37b7-4fd5-aba5-ebe0a1154218'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:36 devstack cinder-volume[94039]: WARNING cinder.quota [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-588462628 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-588462628, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:01:36 devstack cinder-volume[94039]: WARNING cinder.quota [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-588462628 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-588462628, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Created reservations ['7cf58e11-c026-4fb4-9e77-ade9d5537c4a', 'a2d00b90-fcda-443e-8467-8bb31b4e9538', '73df6143-7b4d-4412-af5b-3f7ece442be9', '9c88a795-d2d8-47e7-86d5-f30a6c15029a'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Created reservations ['3e03a2fd-3032-4ec3-882d-aaf5dc35b831', '82072586-2053-4ac7-ac8b-378453cb30fe', '95a7e3c7-1900-40aa-ad27-edbb9e14c05c', '1eb501e9-2030-4642-833e-21f200bfefa4'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:36 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:36 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Acquiring lock "cinder-52624d0d-441c-40ef-9d28-a9dfa9b984f9-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "cinder-52624d0d-441c-40ef-9d28-a9dfa9b984f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Acquiring lock "cinder-quobyte-52624d0d-441c-40ef-9d28-a9dfa9b984f9" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "cinder-quobyte-52624d0d-441c-40ef-9d28-a9dfa9b984f9" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98dcc2a-fde6-411d-9aab-f7ac0a25110d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:37 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.352s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:37 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e2e4d7f3-df2e-4df8-99c5-7666ee32481a tempest-GroupsTest-1831008328 None] Delete group completed successfully. Aug 24 10:01:37 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 Aug 24 10:01:37 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:37 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9" returned: 0 in 0.416s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:37 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9 Aug 24 10:01:37 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:37 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-52624d0d-441c-40ef-9d28-a9dfa9b984f9" returned: 0 in 0.363s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "cinder-quobyte-52624d0d-441c-40ef-9d28-a9dfa9b984f9" released by "delete_volume" :: held 0.841s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Created reservations ['1b8ad527-2810-47d9-a424-f419397632d8', '429d2459-3873-4870-a2eb-250d2f750a8e', '8ae87f4d-21bf-4d76-8e6c-291865956d09', 'a429053b-1836-430e-a86a-c95a02aae5f5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:38 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:01:38 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:38 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:01:38 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Deleted volume successfully. Aug 24 10:01:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fd080e34-4112-43c0-b59b-d2690110593f tempest-AttachVolumeShelveTestJSON-1405631947 None] Lock "cinder-52624d0d-441c-40ef-9d28-a9dfa9b984f9-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:01:48 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=94,cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:01:48 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=110,cinder:INSERT=28,cinder:UPDATE=125,cinder:DELETE=9 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Flow 'volume_create_manager' (407d0dd0-3363-4947-a8c0-5acb16337f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75be5d17-39dc-4228-9497-82da7187c81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75be5d17-39dc-4228-9497-82da7187c81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-43146121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b639ed51-de56-43f9-8688-33b06fd324b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf4142a00b3405ebb5a8944049ee752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:54Z,use_quota=True,user_id='07ce4a79c8b1405cba046987d8ab1245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30761b4-09b4-4f4f-b04b-b037bc51eefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a30761b4-09b4-4f4f-b04b-b037bc51eefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98cf0c5-c3ba-4f53-915f-75e919e20d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98cf0c5-c3ba-4f53-915f-75e919e20d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b639ed51-de56-43f9-8688-33b06fd324b2', 'volume_name': 'volume-b639ed51-de56-43f9-8688-33b06fd324b2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb7df8e-331b-41a4-ab60-26b68ab75f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb7df8e-331b-41a4-ab60-26b68ab75f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721b5fab-1183-440a-a45c-e982ab34e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:53 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Volume b639ed51-de56-43f9-8688-33b06fd324b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b639ed51-de56-43f9-8688-33b06fd324b2', 'volume_size': 1} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-43146121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b639ed51-de56-43f9-8688-33b06fd324b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf4142a00b3405ebb5a8944049ee752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:01:54Z,use_quota=True,user_id='07ce4a79c8b1405cba046987d8ab1245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Creating volume b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:01:53 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:01:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:53 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 1073741824 Aug 24 10:01:53 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:54 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 1073741824" returned: 0 in 0.521s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:01:54 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 Aug 24 10:01:54 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:01:54 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721b5fab-1183-440a-a45c-e982ab34e976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b639ed51-de56-43f9-8688-33b06fd324b2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7305c57c-5a25-43fd-87d2-247f649171c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:01:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Volume volume-b639ed51-de56-43f9-8688-33b06fd324b2 (b639ed51-de56-43f9-8688-33b06fd324b2): created successfully Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7305c57c-5a25-43fd-87d2-247f649171c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:01:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Flow 'volume_create_manager' (407d0dd0-3363-4947-a8c0-5acb16337f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:01:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7beeec56-d1e7-4cfd-bf2a-f16c41a856f7 tempest-TestStampPattern-1763394703 None] Created volume successfully. Aug 24 10:01:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9a402197-0fac-4d52-a4e4-fcaa61283958 tempest-BackendsCapabilitiesAdminTestsJSON-1677119710 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1266860961914, 'free_capacity_gb': 1775.1266860961914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94039) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 24 10:01:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c0ac4f35-3045-44a2-ad2e-0daa08b60d29 tempest-BackendsCapabilitiesAdminTestsJSON-1677119710 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1266860961914, 'free_capacity_gb': 1775.1266860961914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94039) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Flow 'volume_create_manager' (2e6cc8a8-44d2-4d96-954b-d0f8b0846b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b350e876-8795-481f-8f88-3d70e6fef31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b350e876-8795-481f-8f88-3d70e6fef31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-381972232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f453f9-addb-4d38-8748-cdb2be4da155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d2051aa3645c2a0cad2104e8ba825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:03Z,use_quota=True,user_id='2858a81060d84d34b2f642c8abf8ed97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7b3d36-75c8-4356-9e74-1f6aa8194bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7b3d36-75c8-4356-9e74-1f6aa8194bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e578d0-a2ac-4e50-89ca-12d52f4b4321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e578d0-a2ac-4e50-89ca-12d52f4b4321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f453f9-addb-4d38-8748-cdb2be4da155', 'volume_name': 'volume-92f453f9-addb-4d38-8748-cdb2be4da155', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43768287-5af6-449e-bee3-8230c7818264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43768287-5af6-449e-bee3-8230c7818264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38235cae-d554-49de-ad02-753520639636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Volume 92f453f9-addb-4d38-8748-cdb2be4da155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f453f9-addb-4d38-8748-cdb2be4da155', 'volume_size': 1} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-381972232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f453f9-addb-4d38-8748-cdb2be4da155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d2051aa3645c2a0cad2104e8ba825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:03Z,use_quota=True,user_id='2858a81060d84d34b2f642c8abf8ed97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Creating volume 92f453f9-addb-4d38-8748-cdb2be4da155 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:03 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:03 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 1073741824 Aug 24 10:02:03 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:04 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 1073741824" returned: 0 in 0.850s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:04 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 Aug 24 10:02:04 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:04 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155" returned: 0 in 0.444s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38235cae-d554-49de-ad02-753520639636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f453f9-addb-4d38-8748-cdb2be4da155', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba75e56e-8764-43b6-b9a8-5a77ac74cc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Volume volume-92f453f9-addb-4d38-8748-cdb2be4da155 (92f453f9-addb-4d38-8748-cdb2be4da155): created successfully Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba75e56e-8764-43b6-b9a8-5a77ac74cc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Flow 'volume_create_manager' (2e6cc8a8-44d2-4d96-954b-d0f8b0846b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-27f9d953-187f-4a06-a148-ad53b43d6c25 tempest-VolumeQuotasAdminTestJSON-318000412 None] Created volume successfully. Aug 24 10:02:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "cinder-92f453f9-addb-4d38-8748-cdb2be4da155-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "cinder-92f453f9-addb-4d38-8748-cdb2be4da155-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "cinder-quobyte-92f453f9-addb-4d38-8748-cdb2be4da155" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "cinder-quobyte-92f453f9-addb-4d38-8748-cdb2be4da155" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0850761c-f256-4a3b-8847-a3e6af5d01f0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:06 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 Aug 24 10:02:06 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:06 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155" returned: 0 in 0.545s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:06 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155 Aug 24 10:02:06 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:06 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-92f453f9-addb-4d38-8748-cdb2be4da155" returned: 0 in 0.565s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "cinder-quobyte-92f453f9-addb-4d38-8748-cdb2be4da155" released by "delete_volume" :: held 1.222s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Created reservations ['f7b02caa-c0b0-456b-96cb-9b59e7320f67', '891f2989-9bf8-4b21-b344-ffa212832e46', 'aca44dc1-6798-48ca-a695-0de032273aa7', '93f9c3fa-84e3-4133-92d5-d8b445412172'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:07 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:07 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7c34175f-a77a-4892-bf30-54312b1d1d03 tempest-GroupSnapshotsTest-416783804 None] Group tempest-GroupSnapshotsTest-Group-314888738: creating Aug 24 10:02:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7c34175f-a77a-4892-bf30-54312b1d1d03 tempest-GroupSnapshotsTest-416783804 None] Group tempest-GroupSnapshotsTest-Group-314888738: created successfully Aug 24 10:02:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7c34175f-a77a-4892-bf30-54312b1d1d03 tempest-GroupSnapshotsTest-416783804 None] Create group completed successfully. Aug 24 10:02:07 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.600s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Deleted volume successfully. Aug 24 10:02:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-953c3ba8-301a-4216-ac9d-c153fd3ed1c9 tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "cinder-92f453f9-addb-4d38-8748-cdb2be4da155-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Flow 'volume_create_manager' (f896da33-c1f6-4154-a733-ea3ba24750df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b52dd4c-4cb5-4e8e-813d-4f74f03884ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b52dd4c-4cb5-4e8e-813d-4f74f03884ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1730755397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340b6c4d-e89a-4aed-b1d0-9e12957716ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d2051aa3645c2a0cad2104e8ba825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:09Z,use_quota=True,user_id='2858a81060d84d34b2f642c8abf8ed97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087f5196-183c-451b-85a9-ffe4d462b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087f5196-183c-451b-85a9-ffe4d462b352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1927bf14-a25c-4bda-ab80-c546598fb9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1927bf14-a25c-4bda-ab80-c546598fb9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340b6c4d-e89a-4aed-b1d0-9e12957716ce', 'volume_name': 'volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199aefd7-33ac-458e-b0b8-0cdeb0ea6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199aefd7-33ac-458e-b0b8-0cdeb0ea6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c8fde4-78cb-4471-95de-1c69f00862f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:09 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Volume 340b6c4d-e89a-4aed-b1d0-9e12957716ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce', 'volume_size': 1} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1730755397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340b6c4d-e89a-4aed-b1d0-9e12957716ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='253d2051aa3645c2a0cad2104e8ba825',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:09Z,use_quota=True,user_id='2858a81060d84d34b2f642c8abf8ed97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Creating volume 340b6c4d-e89a-4aed-b1d0-9e12957716ce {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:09 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:09 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce 1073741824 Aug 24 10:02:09 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (cda907b9-7e77-49ac-9d24-a7e24b2492c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc90bb8a-415d-4b36-a876-4647058668e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc90bb8a-415d-4b36-a876-4647058668e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269337207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c169a9b3-627d-45e1-a34b-093b0137cd9a,host='devstack@QuobyteHD#QuobyteHD',id=64509180-0a60-4c80-923c-a8e3f08d3e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:10Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06236cba-f3b0-437d-8f90-3b1d2a77174f),volume_type_id=06236cba-f3b0-437d-8f90-3b1d2a77174f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37ef818-7512-4384-9818-ffb82fe94ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b37ef818-7512-4384-9818-ffb82fe94ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005f8570-c2bc-4504-9eb7-75e3584d47e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005f8570-c2bc-4504-9eb7-75e3584d47e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64509180-0a60-4c80-923c-a8e3f08d3e9e', 'volume_name': 'volume-64509180-0a60-4c80-923c-a8e3f08d3e9e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a5995e-f38a-488a-a667-8fc61f252321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a5995e-f38a-488a-a667-8fc61f252321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f899059-dea5-4f1b-b80f-26cd73656a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Volume 64509180-0a60-4c80-923c-a8e3f08d3e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64509180-0a60-4c80-923c-a8e3f08d3e9e', 'volume_size': 1} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:10 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce 1073741824" returned: 0 in 0.908s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:10 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce Aug 24 10:02:10 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:10 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce" returned: 0 in 0.326s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c169a9b3-627d-45e1-a34b-093b0137cd9a,created_at=2026-08-24T08:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269337207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c169a9b3-627d-45e1-a34b-093b0137cd9a,host='devstack@QuobyteHD#QuobyteHD',id=64509180-0a60-4c80-923c-a8e3f08d3e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:10Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06236cba-f3b0-437d-8f90-3b1d2a77174f),volume_type_id=06236cba-f3b0-437d-8f90-3b1d2a77174f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Creating volume 64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:10 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c8fde4-78cb-4471-95de-1c69f00862f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4b7feb-68bb-46f5-9879-c9150aee1abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:10 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e 1073741824 Aug 24 10:02:10 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Volume volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce (340b6c4d-e89a-4aed-b1d0-9e12957716ce): created successfully Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4b7feb-68bb-46f5-9879-c9150aee1abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Flow 'volume_create_manager' (f896da33-c1f6-4154-a733-ea3ba24750df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8764c593-31d6-4439-b1b6-1f82b4f5970c tempest-VolumeQuotasAdminTestJSON-318000412 None] Created volume successfully. Aug 24 10:02:11 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e 1073741824" returned: 0 in 0.819s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:11 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e Aug 24 10:02:11 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:12 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e" returned: 0 in 0.650s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f899059-dea5-4f1b-b80f-26cd73656a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64509180-0a60-4c80-923c-a8e3f08d3e9e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c7baef-d7d8-4afd-942f-dad1c7a63a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:12 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Volume volume-64509180-0a60-4c80-923c-a8e3f08d3e9e (64509180-0a60-4c80-923c-a8e3f08d3e9e): created successfully Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c7baef-d7d8-4afd-942f-dad1c7a63a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (cda907b9-7e77-49ac-9d24-a7e24b2492c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ac24c741-897e-4506-bed6-8f61a63736c5 tempest-GroupSnapshotsTest-416783804 None] Created volume successfully. Aug 24 10:02:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c6f4885b-70be-4385-a271-52a18cd13418 tempest-VolumeQuotasAdminTestJSON-1038513544 None] Transfer volume completed successfully. Aug 24 10:02:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] GroupSnapshot 66e07264-3d72-4080-adec-0b09f18e0641: creating. Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Group snapshot 66e07264-3d72-4080-adec-0b09f18e0641: creating. {{(pid=94039) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Creating offline snapshot f032d93a-d101-4cc1-a1f8-a96c0d60d047 of volume 64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ea2b0a-6ce5-431f-a1b8-b95ea4b7aaac]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:13 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e Aug 24 10:02:13 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Acquiring lock "cinder-340b6c4d-e89a-4aed-b1d0-9e12957716ce-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Lock "cinder-340b6c4d-e89a-4aed-b1d0-9e12957716ce-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Acquiring lock "cinder-quobyte-340b6c4d-e89a-4aed-b1d0-9e12957716ce" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Lock "cinder-quobyte-340b6c4d-e89a-4aed-b1d0-9e12957716ce" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0329fafc-5be7-442b-9d72-3612653a0ac2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:13 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e" returned: 0 in 0.798s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:14 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce Aug 24 10:02:14 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:14 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 1G Aug 24 10:02:14 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:14 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce" returned: 0 in 0.647s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:14 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce Aug 24 10:02:14 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:14 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 1G" returned: 0 in 0.765s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64509180-0a60-4c80-923c-a8e3f08d3e9e -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:14 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64509180-0a60-4c80-923c-a8e3f08d3e9e -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 Aug 24 10:02:14 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:14 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-340b6c4d-e89a-4aed-b1d0-9e12957716ce" returned: 0 in 0.456s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Lock "cinder-quobyte-340b6c4d-e89a-4aed-b1d0-9e12957716ce" released by "delete_volume" :: held 1.204s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Created reservations ['1ccf0da5-81dd-4fc8-a10a-df4fbd7ffafb', '33194567-b835-4a18-b10a-3319023f547b', '9989d77b-d664-48bb-b600-6b1343577416', '6ac67cb4-ed61-4b4c-baa2-0cb49b7b1289'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:15 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64509180-0a60-4c80-923c-a8e3f08d3e9e -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047" returned: 0 in 0.508s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:15 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:15 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:15 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:15 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 Aug 24 10:02:15 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:15 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.412s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Deleted volume successfully. Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d3c385eb-5655-4b65-a907-2741f05ce3b4 tempest-VolumeQuotasAdminTestJSON-1801136294 None] Lock "cinder-340b6c4d-e89a-4aed-b1d0-9e12957716ce-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:15 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047" returned: 0 in 0.496s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:15 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info Aug 24 10:02:15 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:16 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info" returned: 0 in 0.331s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:16 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:16 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info Aug 24 10:02:16 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:16 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.info" returned: 0 in 0.394s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.437s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-59618da7-3410-42d5-856b-d837818fccc7 tempest-GroupSnapshotsTest-416783804 None] group_snapshot 66e07264-3d72-4080-adec-0b09f18e0641: created successfully Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-f032d93a-d101-4cc1-a1f8-a96c0d60d047-779cfdb5-9f44-409e-957d-41345303fccb" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-f032d93a-d101-4cc1-a1f8-a96c0d60d047-779cfdb5-9f44-409e-957d-41345303fccb" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Creating volume 779cfdb5-9f44-409e-957d-41345303fccb from snapshot f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-779cfdb5-9f44-409e-957d-41345303fccb" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-779cfdb5-9f44-409e-957d-41345303fccb" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] snapshot: f032d93a-d101-4cc1-a1f8-a96c0d60d047, volume: 779cfdb5-9f44-409e-957d-41345303fccb, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ad612-fd3b-40cf-9efd-332f6eef69ca]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:18 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 Aug 24 10:02:18 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:19 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047" returned: 0 in 0.684s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64509180-0a60-4c80-923c-a8e3f08d3e9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ef3ff-9aae-46d6-9be4-6942c6ea0871]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:19 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e Aug 24 10:02:19 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:19 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e" returned: 0 in 0.540s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:02:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:19 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb Aug 24 10:02:19 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:26 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:26 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:27 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 1.075s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb" returned: 0 in 7.866s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e, size 1024.00 MB, duration 7.87 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:02:27 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Converted 1024.00 MB image at 130.16 MB/s Aug 24 10:02:27 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:27 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb Aug 24 10:02:27 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:28 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb" returned: 0 in 0.455s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-779cfdb5-9f44-409e-957d-41345303fccb" released by "_copy_volume_from_snapshot" :: held 9.696s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-f032d93a-d101-4cc1-a1f8-a96c0d60d047-779cfdb5-9f44-409e-957d-41345303fccb" released by "_create_volume_from_snapshot" :: held 9.890s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.935s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5cf6d568-9b02-4837-85ef-bde1c1a9570f tempest-GroupSnapshotsTest-416783804 None] Create group from source-snapshot-66e07264-3d72-4080-adec-0b09f18e0641 completed successfully. Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (72093346-a558-4a4c-bd9b-da187bd0ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6095aae6-e303-4186-9680-cd4ee1aba9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6095aae6-e303-4186-9680-cd4ee1aba9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-68957390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e4e993-e1fb-4af8-9ec0-3ddeff98c50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:29Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6183ddc5-a582-4b65-9ed6-78e76cf476ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6183ddc5-a582-4b65-9ed6-78e76cf476ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d30dad6-2529-4f3d-975c-677b38e6453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d30dad6-2529-4f3d-975c-677b38e6453d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e4e993-e1fb-4af8-9ec0-3ddeff98c50d', 'volume_name': 'volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58929a31-97ab-4ad5-bda4-6bcefb53aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58929a31-97ab-4ad5-bda4-6bcefb53aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9e88b0-8b82-421d-98e7-9df93941cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:29 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Volume 27e4e993-e1fb-4af8-9ec0-3ddeff98c50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d', 'volume_size': 1} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-68957390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e4e993-e1fb-4af8-9ec0-3ddeff98c50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:29Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Creating volume 27e4e993-e1fb-4af8-9ec0-3ddeff98c50d {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:29 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:29 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d 1073741824 Aug 24 10:02:29 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-779cfdb5-9f44-409e-957d-41345303fccb" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-779cfdb5-9f44-409e-957d-41345303fccb" acquired by "delete_volume" :: waited 0.047s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd95e25e-70b8-4aa0-9cac-8acb5dcae5c9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:30 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d 1073741824" returned: 0 in 0.908s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:30 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb Aug 24 10:02:30 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:30 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d Aug 24 10:02:30 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:30 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb" returned: 0 in 0.698s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:30 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" returned: 0 in 0.559s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:30 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb Aug 24 10:02:30 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9e88b0-8b82-421d-98e7-9df93941cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda6fdc8-e1ac-4508-94c3-ef2f68b76e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:30 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Volume volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d (27e4e993-e1fb-4af8-9ec0-3ddeff98c50d): created successfully Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda6fdc8-e1ac-4508-94c3-ef2f68b76e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (72093346-a558-4a4c-bd9b-da187bd0ac75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-dd839e81-12a5-465f-bbc8-a8d6b26907aa tempest-VolumesActionsTest-722288854 None] Created volume successfully. Aug 24 10:02:31 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-779cfdb5-9f44-409e-957d-41345303fccb" returned: 0 in 0.434s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-779cfdb5-9f44-409e-957d-41345303fccb" released by "delete_volume" :: held 1.217s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-778102fb-85c7-42db-a0ec-75a810eb26a1 tempest-VolumesActionsTest-722288854 None] Acquiring lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" by "attach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-778102fb-85c7-42db-a0ec-75a810eb26a1 tempest-VolumesActionsTest-722288854 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" acquired by "attach_volume" :: waited 0.045s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Created reservations ['7e44fd79-2020-4a96-b442-67f87391792f'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-778102fb-85c7-42db-a0ec-75a810eb26a1 tempest-VolumesActionsTest-722288854 None] Attaching volume 27e4e993-e1fb-4af8-9ec0-3ddeff98c50d to instance fa5ee20b-5ab1-4dfd-85d2-58229e637047 at mountpoint /dev/vdb on host None. Aug 24 10:02:31 devstack cinder-volume[94039]: WARNING cinder.quota [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1597374016 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1597374016, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:02:31 devstack cinder-volume[94039]: WARNING cinder.quota [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1597374016 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1597374016, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:02:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-778102fb-85c7-42db-a0ec-75a810eb26a1 tempest-VolumesActionsTest-722288854 None] Attach volume completed successfully. Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-778102fb-85c7-42db-a0ec-75a810eb26a1 tempest-VolumesActionsTest-722288854 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" released by "attach_volume" :: held 0.188s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Created reservations ['d00314e6-9c17-4181-95cd-6a17bb7ccdc3', '937352ad-f331-4a25-b6bf-dbe50aa35488', 'e46f0397-bc66-4c88-ab4b-b724fe1e04c1', '588c3631-5d07-4369-b437-a031bbb556d2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:31 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:31 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:31 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.339s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:31 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-24a4a59b-803e-4124-a678-7eee75caec50 tempest-GroupSnapshotsTest-416783804 None] Delete group completed successfully. Aug 24 10:02:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4a68fa4a-ec4f-4cc2-9e4a-a80c68c6c36d tempest-VolumesActionsTest-342961513 None] Terminate volume connection completed successfully. Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4a68fa4a-ec4f-4cc2-9e4a-a80c68c6c36d tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-detach_volume" by "detach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4a68fa4a-ec4f-4cc2-9e4a-a80c68c6c36d tempest-VolumesActionsTest-342961513 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4a68fa4a-ec4f-4cc2-9e4a-a80c68c6c36d tempest-VolumesActionsTest-342961513 None] Detaching volume 27e4e993-e1fb-4af8-9ec0-3ddeff98c50d from instance fa5ee20b-5ab1-4dfd-85d2-58229e637047. Aug 24 10:02:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4a68fa4a-ec4f-4cc2-9e4a-a80c68c6c36d tempest-VolumesActionsTest-342961513 None] Detach volume completed successfully. Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4a68fa4a-ec4f-4cc2-9e4a-a80c68c6c36d tempest-VolumesActionsTest-342961513 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ce725773-74db-4811-a2ab-f7d6f00b50c6 tempest-VolumesActionsTest-722288854 None] Acquiring lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-detach_volume" by "detach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ce725773-74db-4811-a2ab-f7d6f00b50c6 tempest-VolumesActionsTest-722288854 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ce725773-74db-4811-a2ab-f7d6f00b50c6 tempest-VolumesActionsTest-722288854 None] Volume detach called, but volume not attached. Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ce725773-74db-4811-a2ab-f7d6f00b50c6 tempest-VolumesActionsTest-722288854 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Flow 'volume_create_manager' (9b865ffc-39c5-4f70-ac29-2f4b3a978f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1569a3-e41c-45e2-9f0b-663471b7ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] group_snapshot 66e07264-3d72-4080-adec-0b09f18e0641: deleting Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1569a3-e41c-45e2-9f0b-663471b7ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1976254319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a3566e-27e9-4aaf-a321-8b0fc96a0618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1442ea936c8b449eba42a0e748031ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:33Z,use_quota=True,user_id='a6b9982e9f0d402db67742890e3a369d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dddd339-695e-42f2-8d6d-4f7214e3261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dddd339-695e-42f2-8d6d-4f7214e3261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d27ff-968e-4bc2-a7ce-5eabc463b249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473d27ff-968e-4bc2-a7ce-5eabc463b249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a3566e-27e9-4aaf-a321-8b0fc96a0618', 'volume_name': 'volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2afbb8f-58f7-4d79-b41a-cdd7a71c6e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2afbb8f-58f7-4d79-b41a-cdd7a71c6e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11643405-b65f-4537-8131-45451d67de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:33 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Volume 46a3566e-27e9-4aaf-a321-8b0fc96a0618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618', 'volume_size': 1} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1976254319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a3566e-27e9-4aaf-a321-8b0fc96a0618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1442ea936c8b449eba42a0e748031ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:33Z,use_quota=True,user_id='a6b9982e9f0d402db67742890e3a369d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Creating volume 46a3566e-27e9-4aaf-a321-8b0fc96a0618 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:33 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Acquiring lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:33 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 1073741824 Aug 24 10:02:33 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] group_snapshot 66e07264-3d72-4080-adec-0b09f18e0641: deleting {{(pid=94039) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-64509180-0a60-4c80-923c-a8e3f08d3e9e" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-64509180-0a60-4c80-923c-a8e3f08d3e9e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-f032d93a-d101-4cc1-a1f8-a96c0d60d047" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Acquiring lock "cinder-quobyte-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Lock "cinder-quobyte-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-f032d93a-d101-4cc1-a1f8-a96c0d60d047" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Deleting offline snapshot f032d93a-d101-4cc1-a1f8-a96c0d60d047 of volume 64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] snapshot_file for this snap is: volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[920f94a5-4679-4ec7-8ec4-5331a06759b1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31817a7-9744-46ac-a819-8f05349e2e9e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:33 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d Aug 24 10:02:33 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:33 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 Aug 24 10:02:33 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:33 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 1073741824" returned: 0 in 0.577s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:33 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" returned: 0 in 0.440s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:33 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 Aug 24 10:02:33 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:33 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047" returned: 0 in 0.451s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64509180-0a60-4c80-923c-a8e3f08d3e9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:02:33 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d Aug 24 10:02:33 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cd1d16-c4d6-4fdf-b141-44944d0fecee]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:33 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e Aug 24 10:02:33 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:34 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:34 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11643405-b65f-4537-8131-45451d67de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d128c0-0442-4e1a-89f1-28d0f683db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" returned: 0 in 0.377s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:34 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Volume volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 (46a3566e-27e9-4aaf-a321-8b0fc96a0618): created successfully Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d128c0-0442-4e1a-89f1-28d0f683db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Flow 'volume_create_manager' (9b865ffc-39c5-4f70-ac29-2f4b3a978f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Lock "cinder-quobyte-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d" released by "delete_volume" :: held 0.897s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-78dad566-bce4-4d6d-86da-aa30e90f252b tempest-VolumeQuotasNegativeTestJSON-468813152 None] Created volume successfully. Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Created reservations ['48bd8e82-ea84-4ded-80ab-65af84b8c0b1', 'e3b4446e-dfd5-45b4-a0a5-baec19361c85', '6c221bfd-126d-410a-aa75-ca8eae78732a', '59ead210-5b6d-4216-ac34-1410741269c3'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:34 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:34 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:34 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e" returned: 0 in 0.776s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:34 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Deleted volume successfully. Aug 24 10:02:34 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 Aug 24 10:02:34 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ebb5af8c-d1a8-4c20-8347-9b1d0a1be2d6 tempest-VolumesActionsTest-722288854 None] Lock "cinder-27e4e993-e1fb-4af8-9ec0-3ddeff98c50d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:34 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047" returned: 0 in 0.435s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:35 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047 Aug 24 10:02:35 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:35 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e.f032d93a-d101-4cc1-a1f8-a96c0d60d047" returned: 0 in 0.342s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-f032d93a-d101-4cc1-a1f8-a96c0d60d047" released by "_delete_snapshot" :: held 2.169s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-64509180-0a60-4c80-923c-a8e3f08d3e9e" released by "delete_snapshot" :: held 2.239s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:35 devstack cinder-volume[94039]: WARNING cinder.quota [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1597374016 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1597374016, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] Created reservations ['1b5cc022-c151-4264-ac7c-3839ddc5ad4d', '4773bf6d-79f1-4192-a589-fadf6287b54d', '56b9054a-b880-4515-a6c6-0e25444bd33b', '7d08002e-4ee9-43b5-ae44-3fa0bdaade56'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f8d27a56-ba23-4c80-9264-1683765287df req-4a8f0ea8-63f8-4eb5-86d5-47da411b4fd1 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f8d27a56-ba23-4c80-9264-1683765287df req-4a8f0ea8-63f8-4eb5-86d5-47da411b4fd1 tempest-TestStampPattern-1763394703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-80e8306e-07f3-4860-aa5b-f092d1edba2a tempest-GroupSnapshotsTest-416783804 None] group_snapshot 66e07264-3d72-4080-adec-0b09f18e0641: deleted successfully Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f8d27a56-ba23-4c80-9264-1683765287df req-4a8f0ea8-63f8-4eb5-86d5-47da411b4fd1 tempest-TestStampPattern-1763394703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-f8d27a56-ba23-4c80-9264-1683765287df req-4a8f0ea8-63f8-4eb5-86d5-47da411b4fd1 tempest-TestStampPattern-1763394703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-b639ed51-de56-43f9-8688-33b06fd324b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf1aeecf-2e83-46cb-b92a-03a260bdf5d9', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:02:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-f8d27a56-ba23-4c80-9264-1683765287df req-4a8f0ea8-63f8-4eb5-86d5-47da411b4fd1 tempest-TestStampPattern-1763394703 None] attachment_update completed successfully. Aug 24 10:02:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Acquiring lock "cinder-46a3566e-27e9-4aaf-a321-8b0fc96a0618-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "cinder-46a3566e-27e9-4aaf-a321-8b0fc96a0618-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Acquiring lock "cinder-quobyte-46a3566e-27e9-4aaf-a321-8b0fc96a0618" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "cinder-quobyte-46a3566e-27e9-4aaf-a321-8b0fc96a0618" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-64509180-0a60-4c80-923c-a8e3f08d3e9e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-64509180-0a60-4c80-923c-a8e3f08d3e9e" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[547dc8ff-480b-4efb-8f7a-26caaa54a206]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf9d576-1489-482e-965a-9d081383c693]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:37 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e Aug 24 10:02:37 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:37 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 Aug 24 10:02:37 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:37 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618" returned: 0 in 0.563s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:37 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618 Aug 24 10:02:37 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e" returned: 0 in 0.699s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:37 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:37 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e Aug 24 10:02:37 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:38 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-46a3566e-27e9-4aaf-a321-8b0fc96a0618" returned: 0 in 0.349s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "cinder-quobyte-46a3566e-27e9-4aaf-a321-8b0fc96a0618" released by "delete_volume" :: held 1.074s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Created reservations ['3d3cc92d-3226-4429-9559-373a09307eb4', '587e1d93-a137-4ddb-afae-e240dd5a057f', 'ea6f056a-8e99-4061-928b-b2dee34e2a85', '28da0cf9-76bc-4a53-961b-92397d0cdb52'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:38 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64509180-0a60-4c80-923c-a8e3f08d3e9e" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-64509180-0a60-4c80-923c-a8e3f08d3e9e" released by "delete_volume" :: held 1.127s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:38 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:38 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Created reservations ['354abebc-2110-4ac1-b0bb-eb7c7abe74f0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:38 devstack cinder-volume[94039]: WARNING cinder.db.api [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1597374016'] Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Created reservations ['2c52deff-4c0d-4ca1-9d47-e5b9a16bcb4f', 'c4eda68f-0f62-4552-8a13-fe618f27da70', 'c7b090cb-6cc1-4f60-941a-46f165b6be0c', '1594f841-0554-49e7-9618-870ade99ef22'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:38 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:38 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:38 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.334s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:38 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Deleted volume successfully. Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-039047af-26b6-4a5b-a0ed-2d42abf7d450 tempest-VolumeQuotasNegativeTestJSON-468813152 None] Lock "cinder-46a3566e-27e9-4aaf-a321-8b0fc96a0618-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:38 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:38 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:38 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5c977572-0c95-43c3-b4b1-954c91029b4b tempest-GroupSnapshotsTest-416783804 None] Delete group completed successfully. Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (8c16524e-2897-4fba-8eff-eef4aa90d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3757e4-b78e-4f05-af15-b4615ef2ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3757e4-b78e-4f05-af15-b4615ef2ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-389137653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf285521-3d30-4846-8173-daafea80c1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:39Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e1415d-357e-4895-a228-c6353c68c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e1415d-357e-4895-a228-c6353c68c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d946a479-3325-46eb-82a8-7fd6109fa0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d946a479-3325-46eb-82a8-7fd6109fa0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf285521-3d30-4846-8173-daafea80c1d5', 'volume_name': 'volume-bf285521-3d30-4846-8173-daafea80c1d5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71c13f0-8466-4f68-aa1a-bf8c123dcebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71c13f0-8466-4f68-aa1a-bf8c123dcebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e85a22-f377-4d41-8551-83a8ff78ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:39 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Volume bf285521-3d30-4846-8173-daafea80c1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf285521-3d30-4846-8173-daafea80c1d5', 'volume_size': 1} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-389137653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf285521-3d30-4846-8173-daafea80c1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:39Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Creating volume bf285521-3d30-4846-8173-daafea80c1d5 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:39 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:39 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 1073741824 Aug 24 10:02:39 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:40 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 1073741824" returned: 0 in 0.692s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4d311014-e108-4a9a-8fcf-fd21b3c1b141 tempest-GroupSnapshotsTest-416783804 None] Group tempest-GroupSnapshotsTest-Group-162377434: creating Aug 24 10:02:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4d311014-e108-4a9a-8fcf-fd21b3c1b141 tempest-GroupSnapshotsTest-416783804 None] Group tempest-GroupSnapshotsTest-Group-162377434: created successfully Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4d311014-e108-4a9a-8fcf-fd21b3c1b141 tempest-GroupSnapshotsTest-416783804 None] Create group completed successfully. Aug 24 10:02:40 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 Aug 24 10:02:40 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:40 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e85a22-f377-4d41-8551-83a8ff78ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf285521-3d30-4846-8173-daafea80c1d5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f622d4-a6f1-4e28-b5a9-0712fb4ecb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:40 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Volume volume-bf285521-3d30-4846-8173-daafea80c1d5 (bf285521-3d30-4846-8173-daafea80c1d5): created successfully Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f622d4-a6f1-4e28-b5a9-0712fb4ecb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (8c16524e-2897-4fba-8eff-eef4aa90d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6c11cc16-e256-47d3-84c5-3e89a968f3c1 tempest-VolumesActionsTest-722288854 None] Created volume successfully. Aug 24 10:02:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-bf285521-3d30-4846-8173-daafea80c1d5-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Lock "cinder-bf285521-3d30-4846-8173-daafea80c1d5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-quobyte-bf285521-3d30-4846-8173-daafea80c1d5" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-bf285521-3d30-4846-8173-daafea80c1d5" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:41 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe51c59e-5658-4195-8e52-9f9ca922dfd3]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (737c7ad7-779c-41bc-8d57-7cd367fde16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0153b3-3418-46a6-b48f-d17683a21de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:42 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 Aug 24 10:02:42 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0153b3-3418-46a6-b48f-d17683a21de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2018500448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=286af8e9-036a-4555-8819-2569e0ab23e3,host='devstack@QuobyteHD#QuobyteHD',id=fa99d6f4-a722-4dcd-82eb-62600d665718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:42Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df491ebd-4269-4a0b-b0c0-6ad8fce96091),volume_type_id=df491ebd-4269-4a0b-b0c0-6ad8fce96091)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b085ed87-088c-4b24-96a5-be4284030a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b085ed87-088c-4b24-96a5-be4284030a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d320586-dcc8-492c-9bf1-46f44733e1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d320586-dcc8-492c-9bf1-46f44733e1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa99d6f4-a722-4dcd-82eb-62600d665718', 'volume_name': 'volume-fa99d6f4-a722-4dcd-82eb-62600d665718', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e6590c-5207-45ea-af29-cd4d61ab7301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64e6590c-5207-45ea-af29-cd4d61ab7301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204a902b-5be6-4c99-9ad4-6471842c8c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:42 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Volume fa99d6f4-a722-4dcd-82eb-62600d665718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa99d6f4-a722-4dcd-82eb-62600d665718', 'volume_size': 1} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=286af8e9-036a-4555-8819-2569e0ab23e3,created_at=2026-08-24T08:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2018500448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=286af8e9-036a-4555-8819-2569e0ab23e3,host='devstack@QuobyteHD#QuobyteHD',id=fa99d6f4-a722-4dcd-82eb-62600d665718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:42Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df491ebd-4269-4a0b-b0c0-6ad8fce96091),volume_type_id=df491ebd-4269-4a0b-b0c0-6ad8fce96091)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Creating volume fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:42 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:42 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 1073741824 Aug 24 10:02:42 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:42 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5" returned: 0 in 0.566s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:42 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5 Aug 24 10:02:42 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:42 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 1073741824" returned: 0 in 0.597s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:42 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 Aug 24 10:02:42 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:42 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bf285521-3d30-4846-8173-daafea80c1d5" returned: 0 in 0.405s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-bf285521-3d30-4846-8173-daafea80c1d5" released by "delete_volume" :: held 1.064s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:42 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Created reservations ['71fbd9af-5a43-479c-8534-d52f10e98f36', '0eb5ca9f-42cd-4102-926c-7d6320a2a2e0', '6c613d6d-ff46-4ac4-96ac-57096e1612d1', 'a0d7136e-b6e0-400b-b787-a93a8c49ce56'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:43 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:43 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:43 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204a902b-5be6-4c99-9ad4-6471842c8c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa99d6f4-a722-4dcd-82eb-62600d665718', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074b2d9a-1b84-42e4-819a-1a4e551dae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Volume volume-fa99d6f4-a722-4dcd-82eb-62600d665718 (fa99d6f4-a722-4dcd-82eb-62600d665718): created successfully Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074b2d9a-1b84-42e4-819a-1a4e551dae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (737c7ad7-779c-41bc-8d57-7cd367fde16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ba4b1b3c-bb9a-4b77-b2dc-093ab8671ea2 tempest-GroupSnapshotsTest-416783804 None] Created volume successfully. Aug 24 10:02:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-768d1e88-2a8c-41b1-b69a-b3897d0b243d req-e15b513e-e258-4434-b389-4b1e03e52fef tempest-TestStampPattern-1763394703 None] Terminate volume connection completed successfully. Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-768d1e88-2a8c-41b1-b69a-b3897d0b243d req-e15b513e-e258-4434-b389-4b1e03e52fef tempest-TestStampPattern-1763394703 None] Deleting attachment bf1aeecf-2e83-46cb-b92a-03a260bdf5d9. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:02:43 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Deleted volume successfully. Aug 24 10:02:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9046c477-fafd-433b-b841-b1fefe86a69f tempest-VolumesActionsTest-342961513 None] Lock "cinder-bf285521-3d30-4846-8173-daafea80c1d5-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (256105c9-d986-40b8-af36-c4726f37308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f9a4e2-84b3-488a-aa1a-ce8a6ea5974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Creating offline snapshot 174e9d76-4a63-4ccc-b83c-ceacba54f5f5 of volume b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f9a4e2-84b3-488a-aa1a-ce8a6ea5974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2028099977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=286af8e9-036a-4555-8819-2569e0ab23e3,host='devstack@QuobyteHD#QuobyteHD',id=ba01dff7-9f2b-46ca-bcbc-5940e875e171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:44Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df491ebd-4269-4a0b-b0c0-6ad8fce96091),volume_type_id=df491ebd-4269-4a0b-b0c0-6ad8fce96091)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3bd0fe-ea8a-4261-bf85-279c73eeab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3bd0fe-ea8a-4261-bf85-279c73eeab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdfc26a-b98d-4f00-b013-b2810d2a535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdfc26a-b98d-4f00-b013-b2810d2a535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba01dff7-9f2b-46ca-bcbc-5940e875e171', 'volume_name': 'volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afee6871-6390-4e54-9750-87c099e344c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afee6871-6390-4e54-9750-87c099e344c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9914e0c0-aa4e-48bf-a52e-0caaea3fa46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Volume ba01dff7-9f2b-46ca-bcbc-5940e875e171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171', 'volume_size': 1} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec4093-4faf-439f-a61a-b221a175acf6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:44 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 Aug 24 10:02:44 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (5b4621b1-a882-4e16-960f-7d0d5d39ea76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6f313d-4b1c-4e34-ab4d-9415b70e1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6f313d-4b1c-4e34-ab4d-9415b70e1252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-286085126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:45Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771fdc3c-5ebd-4879-9ede-9206e163e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771fdc3c-5ebd-4879-9ede-9206e163e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132c2d6e-b380-4902-b3c6-cd00f2fb7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132c2d6e-b380-4902-b3c6-cd00f2fb7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a', 'volume_name': 'volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d5b0f0-e962-4489-9066-80cf4f83ca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d5b0f0-e962-4489-9066-80cf4f83ca77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58bc871-de47-4af8-9f77-6ef7c68d1c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Volume 4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a', 'volume_size': 1} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:44 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2" returned: 0 in 0.434s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:44 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 1G Aug 24 10:02:44 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:45 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 1G" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b639ed51-de56-43f9-8688-33b06fd324b2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:45 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b639ed51-de56-43f9-8688-33b06fd324b2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 Aug 24 10:02:45 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:45 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b639ed51-de56-43f9-8688-33b06fd324b2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:45 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 is being set with open permissions: ugo+rw Aug 24 10:02:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:45 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 Aug 24 10:02:45 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:45 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5" returned: 0 in 0.280s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:45 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info Aug 24 10:02:45 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:46 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info" returned: 0 in 0.258s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:46 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info is being set with open permissions: ugo+rw Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:46 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info Aug 24 10:02:46 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:46 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.info" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.055s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=286af8e9-036a-4555-8819-2569e0ab23e3,created_at=2026-08-24T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2028099977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=286af8e9-036a-4555-8819-2569e0ab23e3,host='devstack@QuobyteHD#QuobyteHD',id=ba01dff7-9f2b-46ca-bcbc-5940e875e171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:44Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df491ebd-4269-4a0b-b0c0-6ad8fce96091),volume_type_id=df491ebd-4269-4a0b-b0c0-6ad8fce96091)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Creating volume ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:46 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:46 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 1073741824 Aug 24 10:02:46 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8bb4c02e-e9db-4687-b1df-a0b6f1e0ae83 tempest-TestStampPattern-1763394703 None] Create snapshot completed successfully Aug 24 10:02:46 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 1073741824" returned: 0 in 0.506s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:46 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 Aug 24 10:02:46 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:47 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171" returned: 0 in 0.261s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.450s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-286085126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:45Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Creating volume 4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:47 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9914e0c0-aa4e-48bf-a52e-0caaea3fa46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:47 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a 1073741824 Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b4a951-a1b1-4166-84af-9a07bdccde8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:47 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Volume volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 (ba01dff7-9f2b-46ca-bcbc-5940e875e171): created successfully Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b4a951-a1b1-4166-84af-9a07bdccde8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (256105c9-d986-40b8-af36-c4726f37308e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:47 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f9d05fa0-b7b0-4965-80d3-40767845e394 tempest-GroupSnapshotsTest-416783804 None] Created volume successfully. Aug 24 10:02:47 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a 1073741824" returned: 0 in 0.598s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:47 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ddb61f37-6bff-42ae-b576-c16b419599d2 tempest-GroupSnapshotsTest-416783804 None] Update group completed successfully. Aug 24 10:02:47 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a Aug 24 10:02:47 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:48 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a" returned: 0 in 0.261s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58bc871-de47-4af8-9f77-6ef7c68d1c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4a6030-b66e-46bb-a49c-9eda531e6e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Volume volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a (4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a): created successfully Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4a6030-b66e-46bb-a49c-9eda531e6e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (5b4621b1-a882-4e16-960f-7d0d5d39ea76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c2eba175-86de-4187-88b1-636d09489b34 tempest-VolumesActionsTest-722288854 None] Created volume successfully. Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=97,cinder:UPDATE=122,cinder:DELETE=7,cinder:INSERT=24 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=100,cinder:INSERT=25,cinder:SELECT=113,cinder:DELETE=9 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Lock "cinder-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f131b87-cbfd-4b66-b001-5f9c6b5b37d3 tempest-GroupSnapshotsTest-416783804 None] Update group completed successfully. Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-quobyte-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90529af-6b7e-40da-832a-34dbfff7497f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:49 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a Aug 24 10:02:49 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:49 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a" returned: 0 in 0.387s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:49 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a Aug 24 10:02:49 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:49 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a" released by "delete_volume" :: held 0.740s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:49 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Created reservations ['d798b9e2-ae61-4edf-bd52-49d274a2b40c', '0473acf4-f94d-480a-9a23-97638be3d543', 'a5b10471-e004-4aa7-afe1-968ab1bbb744', '3ad14fc5-7197-4d9e-9e06-bd694ebbd702'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:50 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:50 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-50c2b3b9-5896-43b0-9a18-c46e575c0f6b tempest-GroupSnapshotsTest-416783804 None] Update group completed successfully. Aug 24 10:02:50 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.371s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Deleted volume successfully. Aug 24 10:02:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16ddb021-3dfe-4ef6-a05d-0f311a843c31 tempest-VolumesActionsTest-342961513 None] Lock "cinder-4cd16bc0-44b4-458d-afb2-1d8f47bb7b8a-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (b9402c21-b608-41dc-9953-a48d997cecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67457787-44e7-4fc6-b7d3-89f44c92c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67457787-44e7-4fc6-b7d3-89f44c92c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928573654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e1edf6-0164-496d-8a44-bf769fed3c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:51Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae04d3f-d154-432a-a8ed-11860a7ae9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae04d3f-d154-432a-a8ed-11860a7ae9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb53301c-1068-43bc-b8f0-b9d84051c2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb53301c-1068-43bc-b8f0-b9d84051c2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e1edf6-0164-496d-8a44-bf769fed3c16', 'volume_name': 'volume-63e1edf6-0164-496d-8a44-bf769fed3c16', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23f37d8-c07d-437f-a4da-e7430843f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23f37d8-c07d-437f-a4da-e7430843f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac630804-a538-40b8-9abf-b63eb2b81c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:51 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Volume 63e1edf6-0164-496d-8a44-bf769fed3c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e1edf6-0164-496d-8a44-bf769fed3c16', 'volume_size': 1} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928573654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e1edf6-0164-496d-8a44-bf769fed3c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:51Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Creating volume 63e1edf6-0164-496d-8a44-bf769fed3c16 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:51 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:51 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 1073741824 Aug 24 10:02:51 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7054214d-44ff-4784-aa88-f3c185fd3d69 tempest-GroupSnapshotsTest-416783804 None] Update group completed successfully. Aug 24 10:02:51 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 1073741824" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:51 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 Aug 24 10:02:51 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:52 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Flow 'volume_create_manager' (6284f931-1ec3-4e5c-8618-1720d5b05b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7fe4a8-e2d8-4fe0-9738-5bfc5a11c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16" returned: 0 in 0.336s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac630804-a538-40b8-9abf-b63eb2b81c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e1edf6-0164-496d-8a44-bf769fed3c16', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8298497b-6ba5-4cf0-9034-bf67324ec5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7fe4a8-e2d8-4fe0-9738-5bfc5a11c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1522869797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae688ab-76df-4486-b906-e063415050ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6261a2c087e34f67956f98063fee7422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:52Z,use_quota=True,user_id='a52bebc9fee14bbfbc4a8e1edf3e26fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(186a9b2b-4daa-4923-b600-0f131e38daff),volume_type_id=186a9b2b-4daa-4923-b600-0f131e38daff)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2e1724-5612-48b6-b6d0-369d69d0b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2e1724-5612-48b6-b6d0-369d69d0b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98235e91-a5d7-47f3-b8d2-d909fa94c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98235e91-a5d7-47f3-b8d2-d909fa94c97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae688ab-76df-4486-b906-e063415050ed', 'volume_name': 'volume-fae688ab-76df-4486-b906-e063415050ed', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffa9cc6-69a0-4237-8166-924ba92b2120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffa9cc6-69a0-4237-8166-924ba92b2120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98700b57-693f-4b8c-ac6a-dd6d0b70d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:52 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Volume fae688ab-76df-4486-b906-e063415050ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae688ab-76df-4486-b906-e063415050ed', 'volume_size': 1} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1522869797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae688ab-76df-4486-b906-e063415050ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6261a2c087e34f67956f98063fee7422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:52Z,use_quota=True,user_id='a52bebc9fee14bbfbc4a8e1edf3e26fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(186a9b2b-4daa-4923-b600-0f131e38daff),volume_type_id=186a9b2b-4daa-4923-b600-0f131e38daff)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Creating volume fae688ab-76df-4486-b906-e063415050ed {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:52 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:52 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Volume volume-63e1edf6-0164-496d-8a44-bf769fed3c16 (63e1edf6-0164-496d-8a44-bf769fed3c16): created successfully Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8298497b-6ba5-4cf0-9034-bf67324ec5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (b9402c21-b608-41dc-9953-a48d997cecca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:52 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed 1073741824 Aug 24 10:02:52 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2cfbebc3-0c6a-474d-b3f6-f6827b51fa66 tempest-VolumesActionsTest-722288854 None] Created volume successfully. Aug 24 10:02:52 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed 1073741824" returned: 0 in 0.483s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:52 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed Aug 24 10:02:52 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:52 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98700b57-693f-4b8c-ac6a-dd6d0b70d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae688ab-76df-4486-b906-e063415050ed', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b73176-8461-428c-a356-66c237473998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:53 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Volume volume-fae688ab-76df-4486-b906-e063415050ed (fae688ab-76df-4486-b906-e063415050ed): created successfully Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b73176-8461-428c-a356-66c237473998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Flow 'volume_create_manager' (6284f931-1ec3-4e5c-8618-1720d5b05b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-42d44b37-1c5c-4d4d-b000-c21828ed3a1b tempest-VolumeTypesAccessTest-1582115086 None] Created volume successfully. Aug 24 10:02:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] GroupSnapshot 154cae0b-6ccd-4f11-8aaf-8c84eaf8a8dc: creating. Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Group snapshot 154cae0b-6ccd-4f11-8aaf-8c84eaf8a8dc: creating. {{(pid=94039) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Creating offline snapshot 86ace86b-f964-45fd-a81a-93edc376e2dc of volume fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[755df770-831e-40f6-82c6-636cff866639]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-63e1edf6-0164-496d-8a44-bf769fed3c16-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Lock "cinder-63e1edf6-0164-496d-8a44-bf769fed3c16-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-quobyte-63e1edf6-0164-496d-8a44-bf769fed3c16" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-63e1edf6-0164-496d-8a44-bf769fed3c16" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:53 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 Aug 24 10:02:53 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81968cd-dc42-44d9-9414-b3c46ef52250]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:53 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 Aug 24 10:02:53 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:53 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718" returned: 0 in 0.475s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:53 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc 1G Aug 24 10:02:53 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:53 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16" returned: 0 in 0.406s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:53 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16 Aug 24 10:02:53 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:54 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Acquiring lock "cinder-fae688ab-76df-4486-b906-e063415050ed-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63e1edf6-0164-496d-8a44-bf769fed3c16" returned: 0 in 0.279s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-63e1edf6-0164-496d-8a44-bf769fed3c16" released by "delete_volume" :: held 0.747s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Lock "cinder-fae688ab-76df-4486-b906-e063415050ed-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:54 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc 1G" returned: 0 in 0.483s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa99d6f4-a722-4dcd-82eb-62600d665718 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Acquiring lock "cinder-quobyte-fae688ab-76df-4486-b906-e063415050ed" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:54 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa99d6f4-a722-4dcd-82eb-62600d665718 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc Aug 24 10:02:54 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Lock "cinder-quobyte-fae688ab-76df-4486-b906-e063415050ed" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Created reservations ['65831a42-a651-4398-8c71-d7cb31c286c6', '8fd16d3c-4a6e-430e-8afb-b6290f754d38', 'f6416fbf-1ef5-4d51-8e6f-3c77ed5c28cc', '87c07a47-80cd-4cda-8f56-282f6259aa7c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a896660-7c46-4b0f-a657-5ec37548a84e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:54 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:54 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:54 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed Aug 24 10:02:54 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:54 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa99d6f4-a722-4dcd-82eb-62600d665718 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:54 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:54 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc Aug 24 10:02:54 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:54 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Deleted volume successfully. Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-46163494-7599-4440-8277-13a0fbb9761b tempest-VolumesActionsTest-342961513 None] Lock "cinder-63e1edf6-0164-496d-8a44-bf769fed3c16-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:54 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:54 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed Aug 24 10:02:54 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:55 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc" returned: 0 in 0.414s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:55 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info Aug 24 10:02:55 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:55 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fae688ab-76df-4486-b906-e063415050ed" returned: 0 in 0.353s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Lock "cinder-quobyte-fae688ab-76df-4486-b906-e063415050ed" released by "delete_volume" :: held 0.921s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (a5a5e027-e77b-41b7-9e63-fe057f5cbe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb120888-2160-488e-9266-368492a6ae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb120888-2160-488e-9266-368492a6ae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834720253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac589b3-6d4b-4e06-93ce-1823860d8201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:55Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6ed511-bd0a-446b-a50b-6f04c84f73e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6ed511-bd0a-446b-a50b-6f04c84f73e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0862c178-510f-45d0-98e3-36f6dadb94f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0862c178-510f-45d0-98e3-36f6dadb94f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac589b3-6d4b-4e06-93ce-1823860d8201', 'volume_name': 'volume-cac589b3-6d4b-4e06-93ce-1823860d8201', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948ab373-4ced-47ce-bc2d-47f46073c5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948ab373-4ced-47ce-bc2d-47f46073c5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55adb8f0-e7c3-418d-8fad-135adaa37479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Volume cac589b3-6d4b-4e06-93ce-1823860d8201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac589b3-6d4b-4e06-93ce-1823860d8201', 'volume_size': 1} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:55 devstack cinder-volume[94039]: WARNING cinder.quota [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1836800646 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1836800646, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:02:55 devstack cinder-volume[94039]: WARNING cinder.quota [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1836800646 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1836800646, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Created reservations ['9fb5700a-7454-4024-ac87-1b2bd236f3dd', 'b9597f04-ac24-4e91-8360-4771cd1dea21', '29637740-3670-42da-a2d9-d4ca99ecb15b', '8affd3a0-915a-4c42-9733-e461622739c6'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:02:55 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info" returned: 0 in 0.400s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:55 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:55 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info Aug 24 10:02:55 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:55 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Flow 'volume_create_manager' (13ba591c-77a2-478d-8464-20a44acf4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:02:55 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903cd53d-d2b1-4c86-9ed3-2a66b7bcdde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903cd53d-d2b1-4c86-9ed3-2a66b7bcdde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-436915377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215cf299-c3e3-4c58-b0c6-0fc13c02958d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf4142a00b3405ebb5a8944049ee752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=174e9d76-4a63-4ccc-b83c-ceacba54f5f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:55Z,use_quota=True,user_id='07ce4a79c8b1405cba046987d8ab1245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c1a33c-bc22-4c78-93f4-262ca944054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c1a33c-bc22-4c78-93f4-262ca944054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa794455-b0fe-4b08-963b-14702460644a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa794455-b0fe-4b08-963b-14702460644a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '215cf299-c3e3-4c58-b0c6-0fc13c02958d', 'volume_name': 'volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d', 'volume_size': 1, 'snapshot_id': '174e9d76-4a63-4ccc-b83c-ceacba54f5f5'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41437e76-abd9-4eff-9c0f-e47936d4d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41437e76-abd9-4eff-9c0f-e47936d4d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb171841-b08f-4262-a016-170492d15ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:02:55 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Volume 215cf299-c3e3-4c58-b0c6-0fc13c02958d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d', 'volume_size': 1, 'snapshot_id': '174e9d76-4a63-4ccc-b83c-ceacba54f5f5'} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:55 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.info" returned: 0 in 0.301s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.535s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Creating offline snapshot ceda23da-85e0-45f0-a396-6087880af83f of volume ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:02:55 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.305s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:02:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Deleted volume successfully. Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda4119-8af4-4799-85a0-26a5f2873211]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ca19e4b-86ac-4fc4-a5e8-24df05a65a21 tempest-VolumeTypesAccessTest-1582115086 None] Lock "cinder-fae688ab-76df-4486-b906-e063415050ed-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:02:55 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 Aug 24 10:02:55 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:56 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:56 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f 1G Aug 24 10:02:56 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:56 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f 1G" returned: 0 in 0.511s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:56 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f Aug 24 10:02:56 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:57 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:57 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:57 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f Aug 24 10:02:57 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:57 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f" returned: 0 in 0.308s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:57 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info Aug 24 10:02:57 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:57 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:57 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:02:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:57 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info Aug 24 10:02:57 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:58 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.info" returned: 0 in 0.269s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.439s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-quobyte-174e9d76-4a63-4ccc-b83c-ceacba54f5f5-215cf299-c3e3-4c58-b0c6-0fc13c02958d" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-174e9d76-4a63-4ccc-b83c-ceacba54f5f5-215cf299-c3e3-4c58-b0c6-0fc13c02958d" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Creating volume 215cf299-c3e3-4c58-b0c6-0fc13c02958d from snapshot 174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-quobyte-215cf299-c3e3-4c58-b0c6-0fc13c02958d" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-215cf299-c3e3-4c58-b0c6-0fc13c02958d" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] snapshot: 174e9d76-4a63-4ccc-b83c-ceacba54f5f5, volume: 215cf299-c3e3-4c58-b0c6-0fc13c02958d, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9568fb04-a864-4691-8c1a-f54c55a4689c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:58 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-577b9818-989a-4825-99b7-b8343c4157b1 tempest-GroupSnapshotsTest-416783804 None] group_snapshot 154cae0b-6ccd-4f11-8aaf-8c84eaf8a8dc: created successfully Aug 24 10:02:58 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 Aug 24 10:02:58 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:58 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] group_snapshot 154cae0b-6ccd-4f11-8aaf-8c84eaf8a8dc: deleting Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] group_snapshot 154cae0b-6ccd-4f11-8aaf-8c84eaf8a8dc: deleting {{(pid=94039) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-fa99d6f4-a722-4dcd-82eb-62600d665718" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-fa99d6f4-a722-4dcd-82eb-62600d665718" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-86ace86b-f964-45fd-a81a-93edc376e2dc" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-86ace86b-f964-45fd-a81a-93edc376e2dc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Deleting offline snapshot 86ace86b-f964-45fd-a81a-93edc376e2dc of volume fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:02:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] snapshot_file for this snap is: volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0989ddb-107c-49a1-b828-1c6485165546]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:59 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5" returned: 0 in 0.771s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b639ed51-de56-43f9-8688-33b06fd324b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9469f6d3-dcb7-49cf-8e01-d6740a364c28]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:59 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc Aug 24 10:02:59 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:59 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 Aug 24 10:02:59 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:02:59 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc" returned: 0 in 0.722s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa99d6f4-a722-4dcd-82eb-62600d665718(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[33baa6ec-e38c-487f-93f9-af9047b3ef27]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:59 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2" returned: 0 in 0.750s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:02:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:02:59 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d Aug 24 10:02:59 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:00 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 Aug 24 10:03:00 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:00 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718" returned: 0 in 0.597s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:00 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc Aug 24 10:03:00 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:01 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc" returned: 0 in 0.651s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:01 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc Aug 24 10:03:01 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:01 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718.86ace86b-f964-45fd-a81a-93edc376e2dc" returned: 0 in 0.606s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-86ace86b-f964-45fd-a81a-93edc376e2dc" released by "_delete_snapshot" :: held 2.838s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-fa99d6f4-a722-4dcd-82eb-62600d665718" released by "delete_snapshot" :: held 2.906s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-ba01dff7-9f2b-46ca-bcbc-5940e875e171" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ba01dff7-9f2b-46ca-bcbc-5940e875e171" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-ceda23da-85e0-45f0-a396-6087880af83f" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ceda23da-85e0-45f0-a396-6087880af83f" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Deleting offline snapshot ceda23da-85e0-45f0-a396-6087880af83f of volume ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:03:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] snapshot_file for this snap is: volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:03:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a5b24-f3f1-4316-b931-eb62c445247d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:02 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f Aug 24 10:03:02 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:03 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f" returned: 0 in 1.131s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:03:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c645bf-a8ea-4c1d-b14d-fe25d8adfa4c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:03 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 Aug 24 10:03:03 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:04 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171" returned: 0 in 0.935s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:04 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f Aug 24 10:03:04 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:05 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f" returned: 0 in 1.212s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:05 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f Aug 24 10:03:05 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:06 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171.ceda23da-85e0-45f0-a396-6087880af83f" returned: 0 in 0.775s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ceda23da-85e0-45f0-a396-6087880af83f" released by "_delete_snapshot" :: held 4.431s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ba01dff7-9f2b-46ca-bcbc-5940e875e171" released by "delete_snapshot" :: held 4.510s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:06 devstack cinder-volume[94039]: WARNING cinder.quota [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1547634914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1547634914, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:06 devstack cinder-volume[94039]: WARNING cinder.quota [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1547634914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1547634914, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:06 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Created reservations ['417b6d8a-5acc-48ca-bbe2-6d011c27838c', '31e792a7-13d5-4a2a-825a-df2108ccab98', 'c50760e3-9877-4a1a-a16c-02eae552d3ad', '101d8bb8-b528-4b2c-a7a4-e8e11c92f164'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] Created reservations ['f5089c07-fcc9-4b36-b33a-4c42e38b2d5f', '30c39148-3ae0-4282-9e55-6db09bf8a2f9', '66bbe954-f709-47c7-9871-21abe57d3753', 'af0b5a31-c5ed-4bda-b04a-d8eb6961c336'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-943c198c-a43f-45da-85cc-1bf76920c714 tempest-GroupSnapshotsTest-416783804 None] group_snapshot 154cae0b-6ccd-4f11-8aaf-8c84eaf8a8dc: deleted successfully Aug 24 10:03:08 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d" returned: 0 in 8.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:03:08 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Converted 1024.00 MB image at 123.60 MB/s Aug 24 10:03:08 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d is being set with open permissions: ugo+rw Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:08 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d Aug 24 10:03:08 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:08 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d" returned: 0 in 0.469s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-215cf299-c3e3-4c58-b0c6-0fc13c02958d" released by "_copy_volume_from_snapshot" :: held 10.432s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-174e9d76-4a63-4ccc-b83c-ceacba54f5f5-215cf299-c3e3-4c58-b0c6-0fc13c02958d" released by "_create_volume_from_snapshot" :: held 10.545s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.583s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.363s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834720253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac589b3-6d4b-4e06-93ce-1823860d8201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:02:55Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Creating volume cac589b3-6d4b-4e06-93ce-1823860d8201 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:08 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:08 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 1073741824 Aug 24 10:03:08 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb171841-b08f-4262-a016-170492d15ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d', 'volume_size': 1, 'snapshot_id': '174e9d76-4a63-4ccc-b83c-ceacba54f5f5'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b126bec8-3cdf-4f54-9e34-43cf3c46a7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:08 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Volume volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d (215cf299-c3e3-4c58-b0c6-0fc13c02958d): created successfully Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b126bec8-3cdf-4f54-9e34-43cf3c46a7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Flow 'volume_create_manager' (13ba591c-77a2-478d-8464-20a44acf4952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-ba01dff7-9f2b-46ca-bcbc-5940e875e171" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-383edcc7-4f4c-4054-9055-4d0516aa7cd0 tempest-TestStampPattern-1763394703 None] Created volume successfully. Aug 24 10:03:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ba01dff7-9f2b-46ca-bcbc-5940e875e171" acquired by "delete_volume" :: waited 0.086s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d59789-cdc3-4476-a46a-2813c6983246]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:09 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 Aug 24 10:03:09 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:09 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 1073741824" returned: 0 in 1.185s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:09 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171" returned: 0 in 0.784s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:10 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 Aug 24 10:03:10 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:10 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171 Aug 24 10:03:10 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:10 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ba01dff7-9f2b-46ca-bcbc-5940e875e171" returned: 0 in 0.469s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ba01dff7-9f2b-46ca-bcbc-5940e875e171" released by "delete_volume" :: held 1.430s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-fa99d6f4-a722-4dcd-82eb-62600d665718" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-fa99d6f4-a722-4dcd-82eb-62600d665718" acquired by "delete_volume" :: waited 0.050s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:10 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201" returned: 0 in 0.682s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d948f7dd-53ca-43ef-a7ec-167b0d8d406f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55adb8f0-e7c3-418d-8fad-135adaa37479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac589b3-6d4b-4e06-93ce-1823860d8201', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbf6919-6087-4c1a-90b9-332a58599b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Volume volume-cac589b3-6d4b-4e06-93ce-1823860d8201 (cac589b3-6d4b-4e06-93ce-1823860d8201): created successfully Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbf6919-6087-4c1a-90b9-332a58599b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (a5a5e027-e77b-41b7-9e63-fe057f5cbe9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4159b815-5f83-45a5-927a-fbc4584b96b3 tempest-VolumesActionsTest-722288854 None] Created volume successfully. Aug 24 10:03:10 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 Aug 24 10:03:10 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:11 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718" returned: 0 in 0.714s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:11 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718 Aug 24 10:03:11 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-cac589b3-6d4b-4e06-93ce-1823860d8201-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Lock "cinder-cac589b3-6d4b-4e06-93ce-1823860d8201-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:12 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fa99d6f4-a722-4dcd-82eb-62600d665718" returned: 0 in 0.629s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-fa99d6f4-a722-4dcd-82eb-62600d665718" released by "delete_volume" :: held 1.489s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Acquiring lock "cinder-quobyte-cac589b3-6d4b-4e06-93ce-1823860d8201" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-cac589b3-6d4b-4e06-93ce-1823860d8201" acquired by "delete_volume" :: waited 0.040s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[63417c5d-b8cf-48c2-941a-48eebc54e5cb]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Created reservations ['3a7463e6-9350-4aac-99c7-3c44ba5ca1e7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:12 devstack cinder-volume[94039]: WARNING cinder.quota [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1547634914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1547634914, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:12 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 Aug 24 10:03:12 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Created reservations ['8c13d137-acfe-4106-a099-a19f85b7bbac', '315aa547-460e-4d7d-a061-ed84520c1d27', '53fd44a4-0481-432f-8828-142d1dc591d2', 'd3642458-610f-4c3e-b5f1-10f555055fe2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Created reservations ['d9ba15ee-81a9-44b1-8c94-c603e8beae56', 'b1e29fb5-12c8-4e78-acae-4ef2ed4948e9', 'e14b5713-3f20-48b0-bda1-47b94d7fdf45', '20e18a56-697a-4091-8f25-87564062b822'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:12 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:12 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:12 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201" returned: 0 in 0.658s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:12 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201 Aug 24 10:03:12 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:13 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.533s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-387b9a29-757c-4019-8c04-e76e10491aba tempest-GroupSnapshotsTest-416783804 None] Delete group completed successfully. Aug 24 10:03:13 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cac589b3-6d4b-4e06-93ce-1823860d8201" returned: 0 in 0.514s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Lock "cinder-quobyte-cac589b3-6d4b-4e06-93ce-1823860d8201" released by "delete_volume" :: held 1.242s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Created reservations ['88e4e76c-c635-48c4-a102-407f3feb5d48', 'de7dd50b-a859-4017-bf2f-4e397579ac0e', 'b996217a-33ca-4c19-8126-5a122cdd7362', 'a0d15f96-f92d-4400-8a56-4ea2a536c5e2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:13 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:13 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:14 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.478s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:14 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Deleted volume successfully. Aug 24 10:03:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5c13119b-ee5e-4805-88f8-725d35dbadf3 tempest-VolumesActionsTest-342961513 None] Lock "cinder-cac589b3-6d4b-4e06-93ce-1823860d8201-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-76d708ec-f5af-4706-88dd-738f30cc76e9 tempest-GroupSnapshotsTest-416783804 None] Group tempest-GroupSnapshotsTest-Group-1608640253: creating Aug 24 10:03:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-76d708ec-f5af-4706-88dd-738f30cc76e9 tempest-GroupSnapshotsTest-416783804 None] Group tempest-GroupSnapshotsTest-Group-1608640253: created successfully Aug 24 10:03:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-76d708ec-f5af-4706-88dd-738f30cc76e9 tempest-GroupSnapshotsTest-416783804 None] Create group completed successfully. Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (96b4f863-642d-4351-83d3-7b3f2fa26594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03943578-b5d5-46a1-9111-867b1c0c517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03943578-b5d5-46a1-9111-867b1c0c517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111747729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f6fb2a-65c1-476c-ade7-4f87c93f72ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:15Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df95a9b-ddde-49b0-af24-ea48bb878dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df95a9b-ddde-49b0-af24-ea48bb878dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1c5c49-e6fd-4ece-9593-6c63af49ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a1c5c49-e6fd-4ece-9593-6c63af49ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f6fb2a-65c1-476c-ade7-4f87c93f72ed', 'volume_name': 'volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac3f91d-1129-4520-9b77-9960c6eca7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac3f91d-1129-4520-9b77-9960c6eca7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebf1de5-16da-4352-bd10-5952242a4eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:15 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Volume e4f6fb2a-65c1-476c-ade7-4f87c93f72ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed', 'volume_size': 1} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2111747729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f6fb2a-65c1-476c-ade7-4f87c93f72ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfa268bdc4d4aabb5bb514d91cbee71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:15Z,use_quota=True,user_id='97cdfb6359704492beefc6df344f7407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Creating volume e4f6fb2a-65c1-476c-ade7-4f87c93f72ed {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:15 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:15 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed 1073741824 Aug 24 10:03:15 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:16 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed 1073741824" returned: 0 in 0.817s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (06964f0c-e081-4e8d-9a23-33c5b6979249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f536b3b5-2c3d-4177-80a3-5cf1ceb88ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f536b3b5-2c3d-4177-80a3-5cf1ceb88ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-916888555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e3c2b54-5d00-45ab-a8e7-c7a0470b5e86,host='devstack@QuobyteHD#QuobyteHD',id=a8da0cf5-4022-48f6-b164-0efb6d6adbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:16Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c55bebb-aae3-4a33-b812-1779b61e558a),volume_type_id=6c55bebb-aae3-4a33-b812-1779b61e558a)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:16 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12eb010-1953-454d-a04b-b1509c5762e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:16 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12eb010-1953-454d-a04b-b1509c5762e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d67b373-aa43-4d5b-be87-e429087a247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d67b373-aa43-4d5b-be87-e429087a247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8da0cf5-4022-48f6-b164-0efb6d6adbc9', 'volume_name': 'volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dda6bf8-9135-4691-80c9-7dc858f8e048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dda6bf8-9135-4691-80c9-7dc858f8e048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab98e34-be24-4807-9ced-4e224e80e1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Volume a8da0cf5-4022-48f6-b164-0efb6d6adbc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9', 'volume_size': 1} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:16 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed" returned: 0 in 0.318s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.232s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e3c2b54-5d00-45ab-a8e7-c7a0470b5e86,created_at=2026-08-24T08:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-916888555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e3c2b54-5d00-45ab-a8e7-c7a0470b5e86,host='devstack@QuobyteHD#QuobyteHD',id=a8da0cf5-4022-48f6-b164-0efb6d6adbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbff573b08d94ffb99b6d9f5fdb2a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:16Z,use_quota=True,user_id='a4518d42c8ad4b6b8370a6a744c27832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c55bebb-aae3-4a33-b812-1779b61e558a),volume_type_id=6c55bebb-aae3-4a33-b812-1779b61e558a)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Creating volume a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:16 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebf1de5-16da-4352-bd10-5952242a4eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:16 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 1073741824 Aug 24 10:03:16 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b10bbc-eca0-4cb7-b62b-1a7aa06fa80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Volume volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed (e4f6fb2a-65c1-476c-ade7-4f87c93f72ed): created successfully Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b10bbc-eca0-4cb7-b62b-1a7aa06fa80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Flow 'volume_create_manager' (96b4f863-642d-4351-83d3-7b3f2fa26594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c077bd1c-bf21-4a5e-83e1-192aa5443ecb tempest-VolumesActionsTest-722288854 None] Created volume successfully. Aug 24 10:03:17 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 1073741824" returned: 0 in 0.563s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:17 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 Aug 24 10:03:17 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:17 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" returned: 0 in 0.433s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab98e34-be24-4807-9ced-4e224e80e1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed0348e-7b1e-47d3-beb7-7910dd60f57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:17 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Volume volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 (a8da0cf5-4022-48f6-b164-0efb6d6adbc9): created successfully Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed0348e-7b1e-47d3-beb7-7910dd60f57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Flow 'volume_create_manager' (06964f0c-e081-4e8d-9a23-33c5b6979249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e5dc3503-dc8e-4f73-9bbe-35491bd100eb tempest-GroupSnapshotsTest-416783804 None] Created volume successfully. Aug 24 10:03:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Acquiring lock "cinder-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Lock "cinder-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Acquiring lock "cinder-quobyte-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Lock "cinder-quobyte-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b450f-522d-496f-b744-401c023919da]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:18 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed Aug 24 10:03:18 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:19 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:19 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed Aug 24 10:03:19 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] GroupSnapshot 1df46ca8-1014-4025-a869-680ece61be1a: creating. Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Group snapshot 1df46ca8-1014-4025-a869-680ece61be1a: creating. {{(pid=94039) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Creating offline snapshot ef073b4b-5642-4a7b-8ed7-9f0b381d8cad of volume a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfca21ab-9487-40c2-a8e8-73b41b11022d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:19 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed" returned: 0 in 0.348s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Lock "cinder-quobyte-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed" released by "delete_volume" :: held 0.896s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Created reservations ['812ef7d7-c4ad-4c16-aec2-0fed86564fea', 'ef870c71-f4e6-4330-b0d3-5b03574da7a8', '3d2c2d21-f929-4fed-9524-5f7a8833d8bf', '426c2f97-7cc6-4eec-bdf9-66ee2920e5ab'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:19 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 Aug 24 10:03:19 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:19 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:19 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:19 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" returned: 0 in 0.553s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:19 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad 1G Aug 24 10:03:19 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:20 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.455s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Deleted volume successfully. Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8ae0d168-0f13-478d-8c9a-c01810932e8b tempest-VolumesActionsTest-722288854 None] Lock "cinder-e4f6fb2a-65c1-476c-ade7-4f87c93f72ed-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Flow 'volume_create_manager' (0c85d255-4670-4425-8d27-762b550e8308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f62b67b-2a78-4d03-a031-7ac1fcec28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f62b67b-2a78-4d03-a031-7ac1fcec28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-660762257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bba4d09-dfb3-4516-a877-ea2efdb80b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4744a1c7998c401689d67d56433146e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:20Z,use_quota=True,user_id='6a219c99f5d848fbadbf0c9616ede00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe0e9ef-edbb-478e-988c-8d3ce3477a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe0e9ef-edbb-478e-988c-8d3ce3477a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d400e7-1263-4466-b952-c291bde9874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d400e7-1263-4466-b952-c291bde9874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bba4d09-dfb3-4516-a877-ea2efdb80b3e', 'volume_name': 'volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e', 'volume_size': 2}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0884fada-a100-485e-85d5-98856e31f503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0884fada-a100-485e-85d5-98856e31f503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab1104d-41f3-4bb2-b57d-83e4f82fda2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Volume 3bba4d09-dfb3-4516-a877-ea2efdb80b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e', 'volume_size': 2} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:20 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad 1G" returned: 0 in 0.522s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:20 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad Aug 24 10:03:20 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:20 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" returned: 0 in 0.331s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:20 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:03:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:20 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad Aug 24 10:03:20 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:21 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" returned: 0 in 0.266s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:21 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info Aug 24 10:03:21 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:21 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info" returned: 0 in 0.342s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:21 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info is being set with open permissions: ugo+rw: NotImplementedError Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:21 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info Aug 24 10:03:21 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:21 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.info" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-660762257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bba4d09-dfb3-4516-a877-ea2efdb80b3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4744a1c7998c401689d67d56433146e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:20Z,use_quota=True,user_id='6a219c99f5d848fbadbf0c9616ede00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Creating volume 3bba4d09-dfb3-4516-a877-ea2efdb80b3e {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:21 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e 2147483648 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:21 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e 2147483648 Aug 24 10:03:21 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c907b88e-cc4f-41e9-98e0-6ed84fa4d27b tempest-GroupSnapshotsTest-416783804 None] group_snapshot 1df46ca8-1014-4025-a869-680ece61be1a: created successfully Aug 24 10:03:22 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e 2147483648" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:22 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e Aug 24 10:03:22 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] group_snapshot 1df46ca8-1014-4025-a869-680ece61be1a: deleting Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] group_snapshot 1df46ca8-1014-4025-a869-680ece61be1a: deleting {{(pid=94039) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 24 10:03:22 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e" returned: 0 in 0.280s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab1104d-41f3-4bb2-b57d-83e4f82fda2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e', 'volume_size': 2}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faa29e8-d4ed-493b-bafb-817f70cb2b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:22 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Volume volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e (3bba4d09-dfb3-4516-a877-ea2efdb80b3e): created successfully Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9faa29e8-d4ed-493b-bafb-817f70cb2b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Flow 'volume_create_manager' (0c85d255-4670-4425-8d27-762b550e8308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Deleting offline snapshot ef073b4b-5642-4a7b-8ed7-9f0b381d8cad of volume a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] snapshot_file for this snap is: volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3997489f-9772-45a5-bee1-be0d6611780a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e7076a4e-6f27-40d9-a602-7154863b572b tempest-VolumesCloneNegativeTest-1123130654 None] Created volume successfully. Aug 24 10:03:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:22 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad Aug 24 10:03:22 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:23 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea64ea-f49e-4795-868a-f8cca56372a9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:23 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 Aug 24 10:03:23 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Acquiring lock "cinder-3bba4d09-dfb3-4516-a877-ea2efdb80b3e-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Lock "cinder-3bba4d09-dfb3-4516-a877-ea2efdb80b3e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Acquiring lock "cinder-quobyte-3bba4d09-dfb3-4516-a877-ea2efdb80b3e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Lock "cinder-quobyte-3bba4d09-dfb3-4516-a877-ea2efdb80b3e" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[45df6f2f-a116-4914-bcf2-83fc3b5b6a01]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:23 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" returned: 0 in 0.472s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:23 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad Aug 24 10:03:23 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:23 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e Aug 24 10:03:23 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:24 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" returned: 0 in 0.343s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:24 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad Aug 24 10:03:24 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:24 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e" returned: 0 in 0.402s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:24 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e Aug 24 10:03:24 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:24 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9.ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" returned: 0 in 0.252s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-ef073b4b-5642-4a7b-8ed7-9f0b381d8cad" released by "_delete_snapshot" :: held 1.577s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:24 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" released by "delete_snapshot" :: held 1.628s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3bba4d09-dfb3-4516-a877-ea2efdb80b3e" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Lock "cinder-quobyte-3bba4d09-dfb3-4516-a877-ea2efdb80b3e" released by "delete_volume" :: held 0.722s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:24 devstack cinder-volume[94039]: WARNING cinder.quota [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-492404819 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-492404819, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:24 devstack cinder-volume[94039]: WARNING cinder.quota [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-492404819 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-492404819, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Created reservations ['c4390129-89a7-4ff3-81e4-1b7ffaa51dd2', 'd3359f5d-c597-4561-9566-443012bb8a95', 'c41b3f1b-b026-4001-acfb-fae9d6507bf3', '5562d007-f200-40ea-a7e6-460167e4f6b1'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] Created reservations ['80eb9886-a6d3-4431-9351-49cdd912ba4a', 'fa136934-38fb-4d20-b65e-951aa4e1c9be', '43d2943a-66c8-4fc0-af02-c137fd64e2ea', '803de4ab-2929-40d3-a998-c8923f2d1784'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:24 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:24 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fa4cd3e1-5d3c-4cb2-877d-e2b54da00b6d tempest-GroupSnapshotsTest-416783804 None] group_snapshot 1df46ca8-1014-4025-a869-680ece61be1a: deleted successfully Aug 24 10:03:24 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.334s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:24 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Deleted volume successfully. Aug 24 10:03:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-cf3bd05b-8d72-4e7e-a80a-534559d4bcbf tempest-VolumesCloneNegativeTest-1123130654 None] Lock "cinder-3bba4d09-dfb3-4516-a877-ea2efdb80b3e-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "cinder-quobyte-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2989b7ed-295f-4eec-a22a-e06866df297e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:25 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 Aug 24 10:03:25 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:26 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" returned: 0 in 0.542s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:26 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9 Aug 24 10:03:26 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:26 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:26 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:26 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" returned: 0 in 0.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Lock "cinder-quobyte-a8da0cf5-4022-48f6-b164-0efb6d6adbc9" released by "delete_volume" :: held 0.921s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Created reservations ['b6150e94-a5b6-4995-ae1a-c66519e72ce2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:26 devstack cinder-volume[94039]: WARNING cinder.quota [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-492404819 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-492404819, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Created reservations ['a959b9f8-c0d2-4e7a-8756-336a7452fe87', '196229bd-e361-4552-b496-84edb66e8ec6', '0621bf21-5ea6-47dc-8eff-daae9cabe08f', '0ba2f002-167a-4263-8193-398c0c37ac23'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:26 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:03:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:03:26 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:26 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:27 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.413s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-bcb89ad6-0f45-4daf-a740-4b5771222015 tempest-GroupSnapshotsTest-416783804 None] Delete group completed successfully. Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Flow 'volume_create_manager' (da1f9035-d92d-4416-a29c-420d31e00e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf56cf2-395d-44c3-ae76-c37fdf18e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf56cf2-395d-44c3-ae76-c37fdf18e276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1617785384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0b1f8e-025e-46d0-b485-5903283efff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0590d0e0c9ae440ba0362ddfbebe6108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:29Z,use_quota=True,user_id='e5558928695442aa9a99d0bf1f745826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f456ec77-4670-46a4-a11a-5c17198ccb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f456ec77-4670-46a4-a11a-5c17198ccb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63b9d6e-d1ce-48eb-945f-638430bd3d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:29 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63b9d6e-d1ce-48eb-945f-638430bd3d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b0b1f8e-025e-46d0-b485-5903283efff3', 'volume_name': 'volume-7b0b1f8e-025e-46d0-b485-5903283efff3', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2ee057-5bd9-4670-8d5c-74f5c1d06266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2ee057-5bd9-4670-8d5c-74f5c1d06266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26004328-59e2-4c20-a8c5-ca6b71bd03a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:30 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Volume 7b0b1f8e-025e-46d0-b485-5903283efff3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b0b1f8e-025e-46d0-b485-5903283efff3', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Trying to clone 7b0b1f8e-025e-46d0-b485-5903283efff3 from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:03:30 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Image download 20.69 MB at 20.69 MB/s Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[04104815-6f80-437c-95bf-e3685f4693db]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:30 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD Aug 24 10:03:30 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:31 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 is fetched for user e5558928695442aa9a99d0bf1f745826. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3ad923-85de-4488-bf29-6cda51030a9f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:31 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD Aug 24 10:03:31 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:31 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1617785384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b0b1f8e-025e-46d0-b485-5903283efff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0590d0e0c9ae440ba0362ddfbebe6108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:29Z,use_quota=True,user_id='e5558928695442aa9a99d0bf1f745826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Creating volume 7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:31 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:31 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 1073741824 Aug 24 10:03:31 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:32 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 1073741824" returned: 0 in 0.514s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:32 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 Aug 24 10:03:32 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:32 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Attempting download of 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 7b0b1f8e-025e-46d0-b485-5903283efff3. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[846814cd-e84f-4cb0-8f33-96fbc84c3a4e]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:32 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw Aug 24 10:03:32 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:32 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw" returned: 0 in 0.490s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:33 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw Aug 24 10:03:33 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:33 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw" returned: 1 in 0.471s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_059878yw' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:03:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9f04bd-e4ce-4fa1-ab64-3001533702ba]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:33 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD Aug 24 10:03:33 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:34 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:34 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] 75b0df00-ae63-45cf-a244-f0a90610f6d1 was qcow2, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:03:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:34 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 Aug 24 10:03:34 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-a3b333de-b34a-43b5-9218-6826ae1bc2bc req-20a760d3-1c26-4011-b69c-6a2901d32868 tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-a3b333de-b34a-43b5-9218-6826ae1bc2bc req-20a760d3-1c26-4011-b69c-6a2901d32868 tempest-TestStampPattern-1763394703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-a3b333de-b34a-43b5-9218-6826ae1bc2bc req-20a760d3-1c26-4011-b69c-6a2901d32868 tempest-TestStampPattern-1763394703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-a3b333de-b34a-43b5-9218-6826ae1bc2bc req-20a760d3-1c26-4011-b69c-6a2901d32868 tempest-TestStampPattern-1763394703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '943e285c-5e89-4c0e-81ab-2e46565c4dd7', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:03:36 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-a3b333de-b34a-43b5-9218-6826ae1bc2bc req-20a760d3-1c26-4011-b69c-6a2901d32868 tempest-TestStampPattern-1763394703 None] attachment_update completed successfully. Aug 24 10:03:36 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3" returned: 0 in 2.805s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:36 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_cow_s32pdevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:03:36 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Converted 112.00 MB image at 39.91 MB/s Aug 24 10:03:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:36 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 1G Aug 24 10:03:36 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:37 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 1G" returned: 0 in 0.469s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Downloaded image 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 7b0b1f8e-025e-46d0-b485-5903283efff3 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 for user e5558928695442aa9a99d0bf1f745826 is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Marking volume 7b0b1f8e-025e-46d0-b485-5903283efff3 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Copying metadata from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 to 7b0b1f8e-025e-46d0-b485-5903283efff3. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Creating volume glance metadata for volume 7b0b1f8e-025e-46d0-b485-5903283efff3 backed by image 75b0df00-ae63-45cf-a244-f0a90610f6d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26004328-59e2-4c20-a8c5-ca6b71bd03a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b0b1f8e-025e-46d0-b485-5903283efff3', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfc29b3-fb11-472b-9e76-32a375ab1b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:37 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Volume volume-7b0b1f8e-025e-46d0-b485-5903283efff3 (7b0b1f8e-025e-46d0-b485-5903283efff3): created successfully Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfc29b3-fb11-472b-9e76-32a375ab1b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Flow 'volume_create_manager' (da1f9035-d92d-4416-a29c-420d31e00e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:37 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-24580a07-96a9-41ce-9c01-796db5000bc0 tempest-VolumesExtendTest-3448517 None] Created volume successfully. Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Flow 'volume_create_manager' (0eb0f494-1b2a-47f3-a12a-860fa694709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5055789-e48b-4464-bdbd-6d15ff789013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5055789-e48b-4464-bdbd-6d15ff789013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-475556379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23966b3-191e-4c85-aee8-0d7753519724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e987ad840ce443ba8c04c1d9bafa74ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:38Z,use_quota=True,user_id='b6d3d5810b174ecb932a1ad8be9aad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e25102-ee0f-4b2c-aa10-d22878ebdb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e25102-ee0f-4b2c-aa10-d22878ebdb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373ad13f-a07f-4c0a-8fe9-5421ed48bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373ad13f-a07f-4c0a-8fe9-5421ed48bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f23966b3-191e-4c85-aee8-0d7753519724', 'volume_name': 'volume-f23966b3-191e-4c85-aee8-0d7753519724', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3f8818-5062-44a8-9c68-9d0aac35c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3f8818-5062-44a8-9c68-9d0aac35c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47bc3b6-ccd4-435b-988e-44d94b4923d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:38 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Volume f23966b3-191e-4c85-aee8-0d7753519724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f23966b3-191e-4c85-aee8-0d7753519724', 'volume_size': 1} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-475556379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23966b3-191e-4c85-aee8-0d7753519724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e987ad840ce443ba8c04c1d9bafa74ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:38Z,use_quota=True,user_id='b6d3d5810b174ecb932a1ad8be9aad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Creating volume f23966b3-191e-4c85-aee8-0d7753519724 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:38 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:38 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 1073741824 Aug 24 10:03:38 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:38 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 1073741824" returned: 0 in 0.545s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:38 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 Aug 24 10:03:38 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:39 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724" returned: 0 in 0.311s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.597s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47bc3b6-ccd4-435b-988e-44d94b4923d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23966b3-191e-4c85-aee8-0d7753519724', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feea334-c1ee-40ef-afaa-141be47ba1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[676f341e-bc4e-431f-b365-d55880a7b037]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:39 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Volume volume-f23966b3-191e-4c85-aee8-0d7753519724 (f23966b3-191e-4c85-aee8-0d7753519724): created successfully Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feea334-c1ee-40ef-afaa-141be47ba1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Flow 'volume_create_manager' (0eb0f494-1b2a-47f3-a12a-860fa694709b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:39 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-47c0d14c-b7a4-4e6e-b1aa-dfc768be8c2e tempest-VolumesListAdminTestJSON-153064212 None] Created volume successfully. Aug 24 10:03:39 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 Aug 24 10:03:39 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:39 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3" returned: 0 in 0.436s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 2G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:39 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-90994b12-5411-4d90-8b38-db7f51b5b247 req-f298eac6-5101-463c-b9e0-cfec80cc911c tempest-TestStampPattern-1763394703 None] Terminate volume connection completed successfully. Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-90994b12-5411-4d90-8b38-db7f51b5b247 req-f298eac6-5101-463c-b9e0-cfec80cc911c tempest-TestStampPattern-1763394703 None] Deleting attachment 943e285c-5e89-4c0e-81ab-2e46565c4dd7. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 2G" returned: 0 in 0.158s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.635s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:39 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-3c9b7505-dcd0-412a-88bb-9d1d4a154f6d tempest-VolumesExtendTest-3448517 None] Extend volume completed successfully. Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Flow 'volume_create_manager' (3f9abf4b-3dff-4e31-8fff-23d7ea3d978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf3a7a2-569f-4e4d-9f28-eb1f27bcaad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf3a7a2-569f-4e4d-9f28-eb1f27bcaad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-997670123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aa293a-8719-4a19-af42-9377cd880434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e987ad840ce443ba8c04c1d9bafa74ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:41Z,use_quota=True,user_id='b6d3d5810b174ecb932a1ad8be9aad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23beb8a3-4b0a-4164-b418-696e09686e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23beb8a3-4b0a-4164-b418-696e09686e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01863e2f-2e95-423a-8c6b-ed31e3352154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01863e2f-2e95-423a-8c6b-ed31e3352154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65aa293a-8719-4a19-af42-9377cd880434', 'volume_name': 'volume-65aa293a-8719-4a19-af42-9377cd880434', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b9ea10-6f3d-49e7-a66e-910c55f95c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b9ea10-6f3d-49e7-a66e-910c55f95c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad906e8-a1b4-47bb-86e7-6c314c5d17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:40 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Volume 65aa293a-8719-4a19-af42-9377cd880434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65aa293a-8719-4a19-af42-9377cd880434', 'volume_size': 1} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-997670123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65aa293a-8719-4a19-af42-9377cd880434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e987ad840ce443ba8c04c1d9bafa74ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:41Z,use_quota=True,user_id='b6d3d5810b174ecb932a1ad8be9aad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Creating volume 65aa293a-8719-4a19-af42-9377cd880434 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:40 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:40 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 1073741824 Aug 24 10:03:40 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:40 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-7b0b1f8e-025e-46d0-b485-5903283efff3-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Lock "cinder-7b0b1f8e-025e-46d0-b485-5903283efff3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-quobyte-7b0b1f8e-025e-46d0-b485-5903283efff3" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-7b0b1f8e-025e-46d0-b485-5903283efff3" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed09e51-8bdf-4ac0-b737-74238b13590c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:41 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 Aug 24 10:03:41 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 1073741824" returned: 0 in 0.760s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:41 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:41 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 Aug 24 10:03:41 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:41 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3" returned: 0 in 0.656s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:41 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3 Aug 24 10:03:41 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:41 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434" returned: 0 in 0.415s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad906e8-a1b4-47bb-86e7-6c314c5d17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65aa293a-8719-4a19-af42-9377cd880434', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d127582f-4538-4bbb-889b-9c5615740c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:42 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Volume volume-65aa293a-8719-4a19-af42-9377cd880434 (65aa293a-8719-4a19-af42-9377cd880434): created successfully Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d127582f-4538-4bbb-889b-9c5615740c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Flow 'volume_create_manager' (3f9abf4b-3dff-4e31-8fff-23d7ea3d978a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:42 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-19059917-de3b-4186-b17a-b0c9f33f093d tempest-VolumesListAdminTestJSON-153064212 None] Created volume successfully. Aug 24 10:03:42 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7b0b1f8e-025e-46d0-b485-5903283efff3" returned: 0 in 0.565s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-7b0b1f8e-025e-46d0-b485-5903283efff3" released by "delete_volume" :: held 1.296s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Created reservations ['e764ee1c-914f-4148-a3d3-ea98f30d0be1', 'dc719948-c311-4e0f-9edc-660bc90e08ec', 'a64c56b3-d1d8-4eda-8750-ee6b78607ff1', '2512b4b3-31ff-4d1b-811b-06e2bf40345b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:42 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:42 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:42 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.365s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:42 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Deleted volume successfully. Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8eb22ff1-bbe2-49ae-beab-47c7a6bb881e tempest-VolumesExtendTest-3448517 None] Lock "cinder-7b0b1f8e-025e-46d0-b485-5903283efff3-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Flow 'volume_create_manager' (33a8c29c-a717-4e59-9f8f-ab430c15d8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9ad31c-1fbe-4ae7-859d-68b73ae8faf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d9ad31c-1fbe-4ae7-859d-68b73ae8faf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-857736346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0356348b-9b6f-4832-b7d3-ba066a566663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e987ad840ce443ba8c04c1d9bafa74ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:44Z,use_quota=True,user_id='b6d3d5810b174ecb932a1ad8be9aad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48beaa3-e808-4460-8ba8-da48165340f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48beaa3-e808-4460-8ba8-da48165340f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef3a219-a53c-4d69-8c6d-08e51ec107d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef3a219-a53c-4d69-8c6d-08e51ec107d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0356348b-9b6f-4832-b7d3-ba066a566663', 'volume_name': 'volume-0356348b-9b6f-4832-b7d3-ba066a566663', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd24cfc3-42df-47d2-8d2c-894cc19df37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd24cfc3-42df-47d2-8d2c-894cc19df37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27037fd-9072-44a6-bdc5-ca798088b221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Volume 0356348b-9b6f-4832-b7d3-ba066a566663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0356348b-9b6f-4832-b7d3-ba066a566663', 'volume_size': 1} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-857736346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0356348b-9b6f-4832-b7d3-ba066a566663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e987ad840ce443ba8c04c1d9bafa74ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:44Z,use_quota=True,user_id='b6d3d5810b174ecb932a1ad8be9aad53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Creating volume 0356348b-9b6f-4832-b7d3-ba066a566663 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:43 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:43 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 1073741824 Aug 24 10:03:43 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Flow 'volume_create_manager' (27c9b504-2171-4b9f-8a25-4e48d73df269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae277236-eada-4799-9da2-fe2601e1da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae277236-eada-4799-9da2-fe2601e1da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-822941378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d269f76-975c-4b4b-83f0-0b2e00456be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0590d0e0c9ae440ba0362ddfbebe6108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:44Z,use_quota=True,user_id='e5558928695442aa9a99d0bf1f745826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b382b3f9-22eb-465b-8253-ba32ee6c2e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b382b3f9-22eb-465b-8253-ba32ee6c2e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b43bdb-420a-45c7-a98b-3837da88dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b43bdb-420a-45c7-a98b-3837da88dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d269f76-975c-4b4b-83f0-0b2e00456be1', 'volume_name': 'volume-8d269f76-975c-4b4b-83f0-0b2e00456be1', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c543ca-19d6-433e-b46e-31ce30e681fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c543ca-19d6-433e-b46e-31ce30e681fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa23357-1f2f-44e0-bfc3-4bdf23ead91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Volume 8d269f76-975c-4b4b-83f0-0b2e00456be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d269f76-975c-4b4b-83f0-0b2e00456be1', 'volume_size': 1} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:44 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 1073741824" returned: 0 in 0.800s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:44 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 Aug 24 10:03:44 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:44 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663" returned: 0 in 0.281s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-822941378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d269f76-975c-4b4b-83f0-0b2e00456be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0590d0e0c9ae440ba0362ddfbebe6108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:44Z,use_quota=True,user_id='e5558928695442aa9a99d0bf1f745826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Creating volume 8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:44 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27037fd-9072-44a6-bdc5-ca798088b221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0356348b-9b6f-4832-b7d3-ba066a566663', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:44 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 1073741824 Aug 24 10:03:44 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d5709-a091-4c85-a8ab-2c5b63538bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Volume volume-0356348b-9b6f-4832-b7d3-ba066a566663 (0356348b-9b6f-4832-b7d3-ba066a566663): created successfully Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6d5709-a091-4c85-a8ab-2c5b63538bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Flow 'volume_create_manager' (33a8c29c-a717-4e59-9f8f-ab430c15d8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6520e1ed-e0ed-4bf2-a321-ae744244a2d6 tempest-VolumesListAdminTestJSON-153064212 None] Created volume successfully. Aug 24 10:03:45 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-215cf299-c3e3-4c58-b0c6-0fc13c02958d-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 1073741824" returned: 0 in 0.506s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Lock "cinder-215cf299-c3e3-4c58-b0c6-0fc13c02958d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-quobyte-215cf299-c3e3-4c58-b0c6-0fc13c02958d" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:45 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-215cf299-c3e3-4c58-b0c6-0fc13c02958d" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:45 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8201c6-d289-4ff2-9780-dc102493559d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:45 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d Aug 24 10:03:45 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:45 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1" returned: 0 in 0.336s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa23357-1f2f-44e0-bfc3-4bdf23ead91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d269f76-975c-4b4b-83f0-0b2e00456be1', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b79cc-8d46-476f-919d-3cb17b79e1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:45 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Volume volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 (8d269f76-975c-4b4b-83f0-0b2e00456be1): created successfully Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41b79cc-8d46-476f-919d-3cb17b79e1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Flow 'volume_create_manager' (27c9b504-2171-4b9f-8a25-4e48d73df269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-abb2c425-1702-4483-8dd9-9b9e4641250f tempest-VolumesExtendTest-3448517 None] Created volume successfully. Aug 24 10:03:45 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d" returned: 0 in 0.441s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:46 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d Aug 24 10:03:46 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:46 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-215cf299-c3e3-4c58-b0c6-0fc13c02958d" returned: 0 in 0.265s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-215cf299-c3e3-4c58-b0c6-0fc13c02958d" released by "delete_volume" :: held 0.777s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Created reservations ['728d0d01-f5f4-46de-b583-55dad13639f1', 'bf10e481-096e-4844-80d6-d972722e4878', 'ea434ce4-c10c-46dd-891e-9762cec7894e', '8004f4c8-6e0b-4b24-922c-a6f6129d4a21'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:46 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:46 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Creating offline snapshot cfd173e2-fab7-41ef-bd8d-f54806dba506 of volume 8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:03:46 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Flow 'volume_create_manager' (d4debdaf-c8a8-487e-9f2c-348fa2dc02fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fec1f86-e6e7-49e3-88c1-394601db6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee93d29-7a03-4450-b009-d38e6aa7aaad]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.387s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Deleted volume successfully. Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fec1f86-e6e7-49e3-88c1-394601db6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1599195-1054-47be-898d-3211db904a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79a66c357ad4443bab7a014c58450d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:47Z,use_quota=True,user_id='3a03cb3164a446baa69c42dace7886f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9cc25-9b80-425d-8dc3-0df7d548c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb9cc25-9b80-425d-8dc3-0df7d548c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb7426e-8ad1-4e37-9438-a8bd0dde1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb7426e-8ad1-4e37-9438-a8bd0dde1e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1599195-1054-47be-898d-3211db904a37', 'volume_name': 'volume-a1599195-1054-47be-898d-3211db904a37', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d9f8ea-ce4f-40e3-a755-684598a35aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d9f8ea-ce4f-40e3-a755-684598a35aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0dc5d2-082a-4576-bafc-3d68e6652e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:46 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Volume a1599195-1054-47be-898d-3211db904a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1599195-1054-47be-898d-3211db904a37', 'volume_size': 1} Aug 24 10:03:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f21a4430-0b7e-4ba0-a87a-4343962e386e tempest-TestStampPattern-1763394703 None] Lock "cinder-215cf299-c3e3-4c58-b0c6-0fc13c02958d-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:47 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 Aug 24 10:03:47 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-174e9d76-4a63-4ccc-b83c-ceacba54f5f5-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Lock "cinder-174e9d76-4a63-4ccc-b83c-ceacba54f5f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-quobyte-b639ed51-de56-43f9-8688-33b06fd324b2" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-b639ed51-de56-43f9-8688-33b06fd324b2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-quobyte-174e9d76-4a63-4ccc-b83c-ceacba54f5f5" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-174e9d76-4a63-4ccc-b83c-ceacba54f5f5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Deleting offline snapshot 174e9d76-4a63-4ccc-b83c-ceacba54f5f5 of volume b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] snapshot_file for this snap is: volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[560696d4-4b7b-41c0-8584-8df8e9011da8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:47 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1" returned: 0 in 0.507s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:47 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 1G Aug 24 10:03:47 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:47 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 Aug 24 10:03:47 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Flow 'volume_create_manager' (7d27a960-cb55-45a4-b887-68160aae406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99ab591-dee5-4291-b445-6858a9d3b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99ab591-dee5-4291-b445-6858a9d3b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1902222164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbde82ae-303d-4feb-a3c5-c19e5e7952f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bb34c76c1c4b3f92783fab0ead70d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:48Z,use_quota=True,user_id='c1afe52044954cd0870839c19a5714b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(144fbf60-6586-4e91-99b7-0703d00abe95),volume_type_id=144fbf60-6586-4e91-99b7-0703d00abe95)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654e9c41-61d4-4c52-9c6e-3b5ac98110e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654e9c41-61d4-4c52-9c6e-3b5ac98110e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c5f34-62bd-4ab1-a269-248f24e9ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9c5f34-62bd-4ab1-a269-248f24e9ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbde82ae-303d-4feb-a3c5-c19e5e7952f2', 'volume_name': 'volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8ac46a-13be-4bd1-87c0-693df53d3070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8ac46a-13be-4bd1-87c0-693df53d3070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb20faab-7910-478b-9a4b-44309c73b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Volume bbde82ae-303d-4feb-a3c5-c19e5e7952f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2', 'volume_size': 1} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:47 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b639ed51-de56-43f9-8688-33b06fd324b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac97ff9-6c80-4de6-b633-a662fcc46908]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:47 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 1G" returned: 0 in 0.509s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:47 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 Aug 24 10:03:47 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:47 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 Aug 24 10:03:47 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:48 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:48 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 is being set with open permissions: ugo+rw Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:48 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 Aug 24 10:03:48 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:48 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2" returned: 0 in 0.550s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:48 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 Aug 24 10:03:48 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:48 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:48 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info Aug 24 10:03:48 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:48 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:48 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5 Aug 24 10:03:48 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:48 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info" returned: 0 in 0.281s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:48 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info is being set with open permissions: ugo+rw Aug 24 10:03:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:48 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info Aug 24 10:03:48 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:49 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2.174e9d76-4a63-4ccc-b83c-ceacba54f5f5" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-174e9d76-4a63-4ccc-b83c-ceacba54f5f5" released by "_delete_snapshot" :: held 1.757s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-b639ed51-de56-43f9-8688-33b06fd324b2" released by "delete_snapshot" :: held 1.788s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:49 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.info" returned: 0 in 0.241s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1599195-1054-47be-898d-3211db904a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a79a66c357ad4443bab7a014c58450d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:47Z,use_quota=True,user_id='3a03cb3164a446baa69c42dace7886f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Creating volume a1599195-1054-47be-898d-3211db904a37 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:49 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 1073741824 Aug 24 10:03:49 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=159,cinder:UPDATE=171,cinder:INSERT=49,cinder:DELETE=10 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=142,cinder:INSERT=38,cinder:UPDATE=161,cinder:DELETE=10 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:03:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-33290fe4-5601-40e9-a9ba-2dde625e55bc tempest-VolumesExtendTest-3448517 None] Create snapshot completed successfully Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Created reservations ['d1e306ce-ce66-47e4-abe7-6eb46dc3e011', '0acea759-eff4-4cb3-839e-607b2569fe26', '45537042-bdc8-48a9-9981-dd4a1e524a66', '415230e7-ac78-403f-972e-0982ce895c7d'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Delete snapshot completed successfully. Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bcf26c0-04cd-4286-ae8e-76614770be2c tempest-TestStampPattern-1763394703 None] Lock "cinder-174e9d76-4a63-4ccc-b83c-ceacba54f5f5-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:49 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 1073741824" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:49 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 Aug 24 10:03:49 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:49 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37" returned: 0 in 0.263s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1902222164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbde82ae-303d-4feb-a3c5-c19e5e7952f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46bb34c76c1c4b3f92783fab0ead70d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:03:48Z,use_quota=True,user_id='c1afe52044954cd0870839c19a5714b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(144fbf60-6586-4e91-99b7-0703d00abe95),volume_type_id=144fbf60-6586-4e91-99b7-0703d00abe95)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Creating volume bbde82ae-303d-4feb-a3c5-c19e5e7952f2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:03:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0dc5d2-082a-4576-bafc-3d68e6652e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1599195-1054-47be-898d-3211db904a37', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:49 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 1073741824 Aug 24 10:03:49 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfd8213-c9b5-4240-85de-00c5adce3ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:49 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Volume volume-a1599195-1054-47be-898d-3211db904a37 (a1599195-1054-47be-898d-3211db904a37): created successfully Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfd8213-c9b5-4240-85de-00c5adce3ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Flow 'volume_create_manager' (d4debdaf-c8a8-487e-9f2c-348fa2dc02fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1fa2f095-7d1b-47d7-b8e5-55217f1302af tempest-VolumesListAdminTestJSON-9545714 None] Created volume successfully. Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:50 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 1073741824" returned: 0 in 0.578s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:50 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 Aug 24 10:03:50 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:50 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2" returned: 0 in 0.338s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.783s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb20faab-7910-478b-9a4b-44309c73b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c08bd3e-6259-4387-bba6-36951ac54506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ddbef-cdb1-4c81-87d5-8627759caedb]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:50 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Volume volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 (bbde82ae-303d-4feb-a3c5-c19e5e7952f2): created successfully Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c08bd3e-6259-4387-bba6-36951ac54506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:03:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Flow 'volume_create_manager' (7d27a960-cb55-45a4-b887-68160aae406c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:03:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-69c898d3-2cef-4bf0-bf63-c13057403f11 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Created volume successfully. Aug 24 10:03:51 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 Aug 24 10:03:51 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Acquiring lock "cinder-a1599195-1054-47be-898d-3211db904a37-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Lock "cinder-a1599195-1054-47be-898d-3211db904a37-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Acquiring lock "cinder-quobyte-a1599195-1054-47be-898d-3211db904a37" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Lock "cinder-quobyte-a1599195-1054-47be-898d-3211db904a37" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3cd8ad-5f0c-49f2-b88f-9174cee192a7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:51 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "cinder-0356348b-9b6f-4832-b7d3-ba066a566663-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1" returned: 0 in 0.662s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 2G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-0356348b-9b6f-4832-b7d3-ba066a566663-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:51 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 Aug 24 10:03:51 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "cinder-quobyte-0356348b-9b6f-4832-b7d3-ba066a566663" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-quobyte-0356348b-9b6f-4832-b7d3-ba066a566663" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f7e82-8ffa-4d07-9c3a-3697ea5ccb06]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 2G" returned: 0 in 0.225s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.947s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e135e5f6-adc1-4e12-88d8-cba442588aff tempest-VolumesExtendTest-3448517 None] Extend volume completed successfully. Aug 24 10:03:51 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 Aug 24 10:03:51 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:52 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37" returned: 0 in 0.682s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:52 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37 Aug 24 10:03:52 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:52 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663" returned: 0 in 0.744s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:52 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663 Aug 24 10:03:52 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-cfd173e2-fab7-41ef-bd8d-f54806dba506-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:52 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:52 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1599195-1054-47be-898d-3211db904a37" returned: 0 in 0.553s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:52 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Lock "cinder-quobyte-a1599195-1054-47be-898d-3211db904a37" released by "delete_volume" :: held 1.305s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Lock "cinder-cfd173e2-fab7-41ef-bd8d-f54806dba506-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-quobyte-8d269f76-975c-4b4b-83f0-0b2e00456be1" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-8d269f76-975c-4b4b-83f0-0b2e00456be1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-quobyte-cfd173e2-fab7-41ef-bd8d-f54806dba506" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:52 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-cfd173e2-fab7-41ef-bd8d-f54806dba506" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Deleting offline snapshot cfd173e2-fab7-41ef-bd8d-f54806dba506 of volume 8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] snapshot_file for this snap is: volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0356348b-9b6f-4832-b7d3-ba066a566663" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e83346-dc31-4b4c-a76d-59f58c01fdb4]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-quobyte-0356348b-9b6f-4832-b7d3-ba066a566663" released by "delete_volume" :: held 1.185s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Created reservations ['2c963430-320d-48bf-9ea2-2d8b766eaf6f', 'db5077a3-9480-45fb-84af-125cbf6ff3a2', '153a3476-e1c2-42ee-ab17-23a1f66d5111', 'c1b881f8-d563-4ed3-ad2d-2f8d6394b4df'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:52 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Created reservations ['471630ec-3ca3-4b1b-b6e5-6a9d91022e64', '0571f34c-4099-4f31-a6d3-6a87e79afb3a', 'b911acc5-7f45-439e-a808-d0a986e66abc', 'f4487f3d-b6c8-4364-9b27-37095edcd595'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:53 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 Aug 24 10:03:53 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:53 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.415s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-adac204a-97bc-47fe-9923-a68c93c03d53 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Retype volume completed successfully. Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:53 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:53 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:53 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:53 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506" returned: 0 in 0.472s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d269f76-975c-4b4b-83f0-0b2e00456be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc54f4b2-6155-4501-ac09-193ac622e552]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:53 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Deleted volume successfully. Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e423e65a-26c4-463d-9fa5-8898ece6aa3d tempest-VolumesListAdminTestJSON-9545714 None] Lock "cinder-a1599195-1054-47be-898d-3211db904a37-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:53 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Deleted volume successfully. Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-092d80e2-f4f7-4b60-9478-871138b77d3a tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-0356348b-9b6f-4832-b7d3-ba066a566663-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-b639ed51-de56-43f9-8688-33b06fd324b2-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:53 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 Aug 24 10:03:53 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Lock "cinder-b639ed51-de56-43f9-8688-33b06fd324b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Acquiring lock "cinder-quobyte-b639ed51-de56-43f9-8688-33b06fd324b2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-b639ed51-de56-43f9-8688-33b06fd324b2" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[770ee971-8132-40f9-aa3f-1560948aba90]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:53 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 Aug 24 10:03:53 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:53 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1" returned: 0 in 0.463s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:53 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 Aug 24 10:03:53 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Acquiring lock "cinder-bbde82ae-303d-4feb-a3c5-c19e5e7952f2-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "cinder-bbde82ae-303d-4feb-a3c5-c19e5e7952f2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "cinder-65aa293a-8719-4a19-af42-9377cd880434-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-65aa293a-8719-4a19-af42-9377cd880434-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Acquiring lock "cinder-quobyte-bbde82ae-303d-4feb-a3c5-c19e5e7952f2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "cinder-quobyte-65aa293a-8719-4a19-af42-9377cd880434" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "cinder-quobyte-bbde82ae-303d-4feb-a3c5-c19e5e7952f2" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-quobyte-65aa293a-8719-4a19-af42-9377cd880434" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a0c438-0903-45df-b3f7-66b9b49de7bc]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37681e1-016a-40ff-9a2c-d8e03653d326]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2 Aug 24 10:03:54 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 Aug 24 10:03:54 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 Aug 24 10:03:54 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506" returned: 0 in 0.506s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506 Aug 24 10:03:54 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b639ed51-de56-43f9-8688-33b06fd324b2" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Lock "cinder-quobyte-b639ed51-de56-43f9-8688-33b06fd324b2" released by "delete_volume" :: held 0.862s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:54 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434" returned: 0 in 0.402s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Created reservations ['ded84a5b-d1dc-4915-babc-bf5cb07214cb', '32361b97-7853-4c0b-bfce-bf82772bc744', '58516800-be20-40db-b803-b65e938d11ba', 'b229b212-280f-43a7-ac92-ec2aaf1bacf5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:54 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434 Aug 24 10:03:54 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2" returned: 0 in 0.477s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2 Aug 24 10:03:54 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:54 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1.cfd173e2-fab7-41ef-bd8d-f54806dba506" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:54 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-cfd173e2-fab7-41ef-bd8d-f54806dba506" released by "_delete_snapshot" :: held 1.966s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-8d269f76-975c-4b4b-83f0-0b2e00456be1" released by "delete_snapshot" :: held 2.015s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:54 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-65aa293a-8719-4a19-af42-9377cd880434" returned: 0 in 0.352s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Created reservations ['a302b3be-9325-4bb9-a0fa-868fc1722fab', '56930cba-aec9-43f4-b21e-044cb596b3b9', '40bb01f4-26d1-4a8e-aa80-55c20edd350b', '79638bf0-d918-4d9d-ac8b-17446d829be3'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-quobyte-65aa293a-8719-4a19-af42-9377cd880434" released by "delete_volume" :: held 0.816s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:54 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bbde82ae-303d-4feb-a3c5-c19e5e7952f2" returned: 0 in 0.395s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "cinder-quobyte-bbde82ae-303d-4feb-a3c5-c19e5e7952f2" released by "delete_volume" :: held 0.933s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Delete snapshot completed successfully. Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b778c9ae-2360-4fc2-9fea-9f14a448cb48 tempest-VolumesExtendTest-3448517 None] Lock "cinder-cfd173e2-fab7-41ef-bd8d-f54806dba506-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Created reservations ['56ee7bb3-0c10-40c9-8928-578cc49322f5', 'ac2a148d-7365-46f0-934d-33f81a703cb5', '9ce1f5f7-b956-47dc-ade1-5afa6fc11bdf', 'c020e4a3-f862-478a-bd41-c2244af50cdb'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:55 devstack cinder-volume[94039]: WARNING cinder.quota [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:55 devstack cinder-volume[94039]: WARNING cinder.quota [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:03:55 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.420s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Created reservations ['4e60074e-147c-41a4-a3f5-422da01a0b19', 'd834a07c-9bea-42a7-82c4-4385c81dd47b', '60110830-2967-4e14-9818-d7d3ef64a0f1', '4bc3440d-d8a2-46a9-a822-23ef19a2d0a5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Deleted volume successfully. Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c95bcf47-eb5e-49ba-b00d-eee8c074512e tempest-TestStampPattern-1763394703 None] Lock "cinder-b639ed51-de56-43f9-8688-33b06fd324b2-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:55 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:55 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:55 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:55 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "cinder-f23966b3-191e-4c85-aee8-0d7753519724-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-f23966b3-191e-4c85-aee8-0d7753519724-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "cinder-quobyte-f23966b3-191e-4c85-aee8-0d7753519724" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-quobyte-f23966b3-191e-4c85-aee8-0d7753519724" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe771f9-4588-4dad-aca7-b95bde5c602b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:55 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.323s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Deleted volume successfully. Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c904e1ae-6f03-4f99-9a9b-c933e9068f9e tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-65aa293a-8719-4a19-af42-9377cd880434-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:55 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.334s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Deleted volume successfully. Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-012d818d-42ca-46fa-b765-3f1b2396a7e8 tempest-VolumeRetypeWithoutMigrationTest-982004954 None] Lock "cinder-bbde82ae-303d-4feb-a3c5-c19e5e7952f2-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:55 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 Aug 24 10:03:55 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:55 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-8d269f76-975c-4b4b-83f0-0b2e00456be1-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:55 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724 Aug 24 10:03:55 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Lock "cinder-8d269f76-975c-4b4b-83f0-0b2e00456be1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Acquiring lock "cinder-quobyte-8d269f76-975c-4b4b-83f0-0b2e00456be1" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-8d269f76-975c-4b4b-83f0-0b2e00456be1" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c34797-e28b-46b1-b33a-98c3b3a04934]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:56 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 Aug 24 10:03:56 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:56 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f23966b3-191e-4c85-aee8-0d7753519724" returned: 0 in 0.336s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-quobyte-f23966b3-191e-4c85-aee8-0d7753519724" released by "delete_volume" :: held 0.845s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Created reservations ['d4f79979-92ce-4f70-b3f9-57c024dcd849', '0db2c203-0623-4299-a199-1399f3ec4af2', '3fa9cd4f-5c9c-465b-ad26-1e1b72a28c82', '0feb44e6-fffa-48d9-acaf-9484f9ccc893'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:56 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:56 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:56 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1" returned: 0 in 0.530s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:56 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1 Aug 24 10:03:56 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:56 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.334s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:56 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Deleted volume successfully. Aug 24 10:03:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465aad8e-0588-4bae-a50e-6410d859b9ad tempest-VolumesListAdminTestJSON-153064212 None] Lock "cinder-f23966b3-191e-4c85-aee8-0d7753519724-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:57 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8d269f76-975c-4b4b-83f0-0b2e00456be1" returned: 0 in 0.391s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Lock "cinder-quobyte-8d269f76-975c-4b4b-83f0-0b2e00456be1" released by "delete_volume" :: held 1.005s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Created reservations ['b3d96853-aac3-4f29-b1de-61f4536b48bb', 'eecf47e8-da1c-4f30-a616-ab437f4e3729', '6e70efdc-7018-4f6e-8042-9bdd41974819', 'f981d1d3-e9d0-4bdf-8757-1c0276505710'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:03:57 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:03:57 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:03:57 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:03:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Deleted volume successfully. Aug 24 10:03:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-614cab23-422d-41e3-ae36-09a26cf52dcc tempest-VolumesExtendTest-3448517 None] Lock "cinder-8d269f76-975c-4b4b-83f0-0b2e00456be1-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (cc963574-dba3-42e5-a68a-8bdf5faa822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6204144d-eed7-4f03-81d6-de75f4d7194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6204144d-eed7-4f03-81d6-de75f4d7194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1536950431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609f478b-36ce-4a3b-a531-0d94557f343b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:03Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54424e24-631e-4e34-b518-d9e288d2ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54424e24-631e-4e34-b518-d9e288d2ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956210cc-aab8-45b6-aec6-90baffffef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956210cc-aab8-45b6-aec6-90baffffef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609f478b-36ce-4a3b-a531-0d94557f343b', 'volume_name': 'volume-609f478b-36ce-4a3b-a531-0d94557f343b', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116b199e-1cc6-4775-af4b-ec1284bc968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116b199e-1cc6-4775-af4b-ec1284bc968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87866c85-d24c-43fd-96cd-357c3a17fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Volume 609f478b-36ce-4a3b-a531-0d94557f343b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609f478b-36ce-4a3b-a531-0d94557f343b', 'volume_size': 1} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1536950431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609f478b-36ce-4a3b-a531-0d94557f343b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:03Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Creating volume 609f478b-36ce-4a3b-a531-0d94557f343b {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:03 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:03 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b 1073741824 Aug 24 10:04:03 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:03 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b 1073741824" returned: 0 in 0.686s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:04 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b Aug 24 10:04:04 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:04 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b" returned: 0 in 0.310s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87866c85-d24c-43fd-96cd-357c3a17fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609f478b-36ce-4a3b-a531-0d94557f343b', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e5e104-8728-410e-a59c-d69a164f32fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Volume volume-609f478b-36ce-4a3b-a531-0d94557f343b (609f478b-36ce-4a3b-a531-0d94557f343b): created successfully Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e5e104-8728-410e-a59c-d69a164f32fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (cc963574-dba3-42e5-a68a-8bdf5faa822a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-71be02f1-ae2f-48ba-8d5c-ea4be7e1bfb0 tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Flow 'volume_create_manager' (fc90c89b-5f95-43c0-805f-b5004bdf4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c7d6f4-ba22-44f6-9edd-f14534bf34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c7d6f4-ba22-44f6-9edd-f14534bf34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1734708317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e6dad4-5223-40e5-adf2-9945b3184023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6261b254d3be46948dc2d59b4bd0450c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:06Z,use_quota=True,user_id='0e2ee857a31744bd8c80a3968bd09535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fb2825-5b47-4dc8-944d-08f4b8414ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fb2825-5b47-4dc8-944d-08f4b8414ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26b4d8a-96af-4d6b-a224-d6c3bc858303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26b4d8a-96af-4d6b-a224-d6c3bc858303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e6dad4-5223-40e5-adf2-9945b3184023', 'volume_name': 'volume-58e6dad4-5223-40e5-adf2-9945b3184023', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7db6ee-c22d-45be-9382-44fd3652530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7db6ee-c22d-45be-9382-44fd3652530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6122a9e8-eafd-41bc-8366-5863efa5de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Volume 58e6dad4-5223-40e5-adf2-9945b3184023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e6dad4-5223-40e5-adf2-9945b3184023', 'volume_size': 1} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1734708317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e6dad4-5223-40e5-adf2-9945b3184023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6261b254d3be46948dc2d59b4bd0450c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:06Z,use_quota=True,user_id='0e2ee857a31744bd8c80a3968bd09535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Creating volume 58e6dad4-5223-40e5-adf2-9945b3184023 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:06 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 1073741824 Aug 24 10:04:06 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (326c9960-6ac4-44f3-94b2-72c8127df34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3898008-d98a-4a87-8a02-7face8c1b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3898008-d98a-4a87-8a02-7face8c1b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1324924974',display_name='tempest-VolumesGetTest-Volume-1099887328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad85462-7359-40b9-a455-b1bd151a8395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:06Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7483fc-1710-4d7c-b4f7-0a55b905f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7483fc-1710-4d7c-b4f7-0a55b905f09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecebe413-5037-40a0-8f40-ddd30044b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecebe413-5037-40a0-8f40-ddd30044b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad85462-7359-40b9-a455-b1bd151a8395', 'volume_name': 'volume-fad85462-7359-40b9-a455-b1bd151a8395', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d3a61d-e258-4047-8606-bdb85a908e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d3a61d-e258-4047-8606-bdb85a908e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbe5b88-4d36-4d77-96c1-e7287a341386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Volume fad85462-7359-40b9-a455-b1bd151a8395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad85462-7359-40b9-a455-b1bd151a8395', 'volume_size': 1} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:06 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 1073741824" returned: 0 in 0.564s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:07 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 Aug 24 10:04:07 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:07 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.657s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1324924974',display_name='tempest-VolumesGetTest-Volume-1099887328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad85462-7359-40b9-a455-b1bd151a8395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:06Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Creating volume fad85462-7359-40b9-a455-b1bd151a8395 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:07 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6122a9e8-eafd-41bc-8366-5863efa5de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e6dad4-5223-40e5-adf2-9945b3184023', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:07 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 1073741824 Aug 24 10:04:07 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a2a510-f0e2-4f7b-97d1-577c5cd33891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Volume volume-58e6dad4-5223-40e5-adf2-9945b3184023 (58e6dad4-5223-40e5-adf2-9945b3184023): created successfully Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a2a510-f0e2-4f7b-97d1-577c5cd33891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Flow 'volume_create_manager' (fc90c89b-5f95-43c0-805f-b5004bdf4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8c61d3c1-0d1f-4958-b804-c81cb80b4bb3 tempest-VolumesServicesTestJSON-1886352805 None] Created volume successfully. Aug 24 10:04:07 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 1073741824" returned: 0 in 0.522s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:07 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 Aug 24 10:04:07 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:08 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395" returned: 0 in 0.316s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bbe5b88-4d36-4d77-96c1-e7287a341386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad85462-7359-40b9-a455-b1bd151a8395', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d2e7d2-c53b-41fc-ba62-74c8b3f1be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:08 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Volume volume-fad85462-7359-40b9-a455-b1bd151a8395 (fad85462-7359-40b9-a455-b1bd151a8395): created successfully Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d2e7d2-c53b-41fc-ba62-74c8b3f1be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (326c9960-6ac4-44f3-94b2-72c8127df34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-69e6e440-4664-46a6-97e4-651debd250a3 tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Acquiring lock "cinder-58e6dad4-5223-40e5-adf2-9945b3184023-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Lock "cinder-58e6dad4-5223-40e5-adf2-9945b3184023-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Acquiring lock "cinder-quobyte-58e6dad4-5223-40e5-adf2-9945b3184023" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Lock "cinder-quobyte-58e6dad4-5223-40e5-adf2-9945b3184023" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fcea17-7989-49f1-9913-fc2d29b99ace]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-fad85462-7359-40b9-a455-b1bd151a8395-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Lock "cinder-fad85462-7359-40b9-a455-b1bd151a8395-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-fad85462-7359-40b9-a455-b1bd151a8395" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:08 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 Aug 24 10:04:08 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-fad85462-7359-40b9-a455-b1bd151a8395" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3219fd8e-38d6-4faa-9de0-43b29cfa3aa2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:09 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 Aug 24 10:04:09 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:09 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023" returned: 0 in 0.536s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:09 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023 Aug 24 10:04:09 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:09 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395" returned: 0 in 0.430s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:09 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395 Aug 24 10:04:09 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:09 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-58e6dad4-5223-40e5-adf2-9945b3184023" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Lock "cinder-quobyte-58e6dad4-5223-40e5-adf2-9945b3184023" released by "delete_volume" :: held 1.021s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Created reservations ['b5bc0a4f-a462-42db-8bd0-7843c797f7ff', '26aaa274-2ff9-46ad-950d-f14b746b36f4', '53cd705a-e101-4e0c-8160-f49e6049f296', '5a31e725-dfb1-47ea-9098-1f32dd390721'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:09 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fad85462-7359-40b9-a455-b1bd151a8395" returned: 0 in 0.454s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-fad85462-7359-40b9-a455-b1bd151a8395" released by "delete_volume" :: held 0.961s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:09 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:09 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:09 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Created reservations ['40c1ef34-655d-4662-b78b-d1d8eb7587e4', 'b159edd3-650d-4516-a805-31f8a074dab8', 'c09147fe-1846-4989-95a6-59be23fd240f', 'f0396657-4f31-48e5-9f8d-7b9b3a623cfd'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:10 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:10 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Flow 'volume_create_manager' (ed3c1316-0467-4d2e-8d94-442f5d491c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e56d6b-adba-40d4-9db0-99d85b60c4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e56d6b-adba-40d4-9db0-99d85b60c4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1641796305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c17156-6bc4-4214-9aba-11e7dd829653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3602c911e0d94a80b4dc264d8202783e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:10Z,use_quota=True,user_id='434d693453cb427a96abb11ddd8cd893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8851752-fc9b-48cc-8ed1-771ef96f9ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8851752-fc9b-48cc-8ed1-771ef96f9ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b628a0d-3289-4a94-ac92-c3cb9adcd7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b628a0d-3289-4a94-ac92-c3cb9adcd7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c17156-6bc4-4214-9aba-11e7dd829653', 'volume_name': 'volume-a1c17156-6bc4-4214-9aba-11e7dd829653', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f7c5bd-b840-4a05-b5c2-410442400d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f7c5bd-b840-4a05-b5c2-410442400d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584bd79e-00ca-4e2f-9c53-b91f35c057ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Volume a1c17156-6bc4-4214-9aba-11e7dd829653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c17156-6bc4-4214-9aba-11e7dd829653', 'volume_size': 1} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1641796305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c17156-6bc4-4214-9aba-11e7dd829653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3602c911e0d94a80b4dc264d8202783e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:10Z,use_quota=True,user_id='434d693453cb427a96abb11ddd8cd893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Creating volume a1c17156-6bc4-4214-9aba-11e7dd829653 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:10 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:10 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.347s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Deleted volume successfully. Aug 24 10:04:10 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 1073741824 Aug 24 10:04:10 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-56cc0932-5db0-49ab-b448-3a7442f0603e tempest-VolumesServicesTestJSON-1886352805 None] Lock "cinder-58e6dad4-5223-40e5-adf2-9945b3184023-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:10 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.290s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68c0c776-e0fb-41af-a882-3c176504e178 tempest-VolumesGetTest-1802578684 None] Lock "cinder-fad85462-7359-40b9-a455-b1bd151a8395-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:10 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 1073741824" returned: 0 in 0.480s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:10 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 Aug 24 10:04:10 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:11 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653" returned: 0 in 0.280s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584bd79e-00ca-4e2f-9c53-b91f35c057ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c17156-6bc4-4214-9aba-11e7dd829653', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb6e327-7fd2-482c-a5eb-567831f124fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Volume volume-a1c17156-6bc4-4214-9aba-11e7dd829653 (a1c17156-6bc4-4214-9aba-11e7dd829653): created successfully Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb6e327-7fd2-482c-a5eb-567831f124fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Flow 'volume_create_manager' (ed3c1316-0467-4d2e-8d94-442f5d491c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-33b39fc7-726c-42a6-b2fe-c5595a5e493b tempest-VolumesTransfersTest-483201948 None] Created volume successfully. Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-609f478b-36ce-4a3b-a531-0d94557f343b-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Lock "cinder-609f478b-36ce-4a3b-a531-0d94557f343b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-609f478b-36ce-4a3b-a531-0d94557f343b" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-609f478b-36ce-4a3b-a531-0d94557f343b" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f15a7-535a-4bde-b9cd-e51991e32270]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:11 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b Aug 24 10:04:11 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:11 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b" returned: 0 in 0.394s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:11 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b Aug 24 10:04:11 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:11 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-609f478b-36ce-4a3b-a531-0d94557f343b" returned: 0 in 0.275s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-609f478b-36ce-4a3b-a531-0d94557f343b" released by "delete_volume" :: held 0.716s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Created reservations ['18d2f681-af4e-43db-8845-ed9a2381330a', '451c9614-c642-4dfd-b7f9-da6311b33045', 'e0cc058e-1a42-4683-8bce-677ad578ffe7', '156be2d9-da45-4c58-8482-416e7c02fa0f'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:12 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:12 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:12 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.327s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-58186f07-37fc-4385-8a23-c73efd0351d6 tempest-VolumesGetTest-1802578684 None] Lock "cinder-609f478b-36ce-4a3b-a531-0d94557f343b-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (de6f375a-a806-4129-86ae-38d091078ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46eb5bc-0516-4757-994d-eeb436da22ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46eb5bc-0516-4757-994d-eeb436da22ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1886147876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b99b59-f110-44e0-b9fd-79e5be987ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:13Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f445f2bb-9490-4689-8aa0-eed8c7a5c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f445f2bb-9490-4689-8aa0-eed8c7a5c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea4374c-c4b9-4f81-aad6-ea617169030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea4374c-c4b9-4f81-aad6-ea617169030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b99b59-f110-44e0-b9fd-79e5be987ad7', 'volume_name': 'volume-16b99b59-f110-44e0-b9fd-79e5be987ad7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfeebf6-0cfd-4029-be97-4ec79668d12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfeebf6-0cfd-4029-be97-4ec79668d12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee50d3f1-8c70-4891-a017-1d89009c569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:13 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Volume 16b99b59-f110-44e0-b9fd-79e5be987ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b99b59-f110-44e0-b9fd-79e5be987ad7', 'volume_size': 1} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1886147876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b99b59-f110-44e0-b9fd-79e5be987ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:13Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Creating volume 16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:13 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:13 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 1073741824 Aug 24 10:04:13 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0068c09a-3851-41c8-8d9a-0ef394038178 tempest-VolumesTransfersTest-1337127434 None] Transfer volume completed successfully. Aug 24 10:04:13 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 1073741824" returned: 0 in 0.561s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:13 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 Aug 24 10:04:13 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Acquiring lock "cinder-a1c17156-6bc4-4214-9aba-11e7dd829653-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Lock "cinder-a1c17156-6bc4-4214-9aba-11e7dd829653-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Acquiring lock "cinder-quobyte-a1c17156-6bc4-4214-9aba-11e7dd829653" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Lock "cinder-quobyte-a1c17156-6bc4-4214-9aba-11e7dd829653" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e105375-7286-4687-a947-5c26ef7ed9f8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:14 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7" returned: 0 in 0.507s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee50d3f1-8c70-4891-a017-1d89009c569a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b99b59-f110-44e0-b9fd-79e5be987ad7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab84a0f-5858-4287-8579-bf98efc2a509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:14 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Volume volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 (16b99b59-f110-44e0-b9fd-79e5be987ad7): created successfully Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab84a0f-5858-4287-8579-bf98efc2a509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (de6f375a-a806-4129-86ae-38d091078ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:14 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 Aug 24 10:04:14 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0a6e69ae-8493-42e1-b0c0-999887633ac9 tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:14 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653" returned: 0 in 0.412s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:14 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653 Aug 24 10:04:14 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:14 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a1c17156-6bc4-4214-9aba-11e7dd829653" returned: 0 in 0.293s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Lock "cinder-quobyte-a1c17156-6bc4-4214-9aba-11e7dd829653" released by "delete_volume" :: held 0.767s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:14 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Created reservations ['ad824668-fc9a-467d-8d2c-c0ab13fc4f82', 'bf08a3bb-e77e-4777-9e27-ccb1e1ebf984', 'f11e6ad5-e4bd-478f-9d1a-88ba90fe1cf3', '42370ff5-1a4c-499e-b161-0023d4428c9c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:15 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:15 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:15 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.353s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Deleted volume successfully. Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9cf1797-0c89-4da3-8381-3dbac78fb2cb tempest-VolumesTransfersTest-903893753 None] Lock "cinder-a1c17156-6bc4-4214-9aba-11e7dd829653-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (30433209-63f3-49a6-afb5-fa80da0ce438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268a7e95-d11c-46f7-95c2-c6ec481f8652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268a7e95-d11c-46f7-95c2-c6ec481f8652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1758877758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8450dc4c-a32a-4d88-8cc8-21924f088731,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=16b99b59-f110-44e0-b9fd-79e5be987ad7,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:16Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df32187-2859-45d4-ae76-99d4d072c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df32187-2859-45d4-ae76-99d4d072c828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345abdbf-4904-48a2-9d3c-b7c681ef6301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345abdbf-4904-48a2-9d3c-b7c681ef6301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8450dc4c-a32a-4d88-8cc8-21924f088731', 'volume_name': 'volume-8450dc4c-a32a-4d88-8cc8-21924f088731', 'volume_size': 1, 'source_volid': '16b99b59-f110-44e0-b9fd-79e5be987ad7', 'source_volstatus': 'available'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc7135a-3f85-4b10-84ca-8fc54b11d3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc7135a-3f85-4b10-84ca-8fc54b11d3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dfed5a-316d-4517-bbab-f05b4c1df0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Volume 8450dc4c-a32a-4d88-8cc8-21924f088731: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8450dc4c-a32a-4d88-8cc8-21924f088731', 'volume_size': 1, 'source_volid': '16b99b59-f110-44e0-b9fd-79e5be987ad7', 'source_volstatus': 'available'} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:16 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Cloning volume 16b99b59-f110-44e0-b9fd-79e5be987ad7 to volume 8450dc4c-a32a-4d88-8cc8-21924f088731 Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Creating offline snapshot 9a195d3d-c2ca-4375-9746-ba8de8b966a7 of volume 16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5c989-f175-4262-a7ec-e22dd90342fe]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Flow 'volume_create_manager' (9fd80345-4f5b-4148-8d0f-74265fdb9090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699cc41a-efb4-4124-8abd-da64e996f14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699cc41a-efb4-4124-8abd-da64e996f14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1796690721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3943653-5166-4d7f-90dd-a529e0d2b8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3602c911e0d94a80b4dc264d8202783e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:16Z,use_quota=True,user_id='434d693453cb427a96abb11ddd8cd893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e0ab6c-d6e0-49ba-a331-d45a01f90e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e0ab6c-d6e0-49ba-a331-d45a01f90e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5d437f-52fb-48c6-b522-af9820e91a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5d437f-52fb-48c6-b522-af9820e91a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3943653-5166-4d7f-90dd-a529e0d2b8f6', 'volume_name': 'volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a33aa3-dd39-4465-be86-1fc0ac59c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a33aa3-dd39-4465-be86-1fc0ac59c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510e4fa8-4061-4585-b7cd-061159540f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Volume a3943653-5166-4d7f-90dd-a529e0d2b8f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6', 'volume_size': 1} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:16 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 Aug 24 10:04:16 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:16 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7" returned: 0 in 0.436s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:16 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 1G Aug 24 10:04:16 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:17 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 1G" returned: 0 in 0.492s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:17 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 Aug 24 10:04:17 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Flow 'volume_create_manager' (63cc1615-140a-48ae-abae-f03afde2919d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd788afc-7606-4617-8077-ee2dc09306e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd788afc-7606-4617-8077-ee2dc09306e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff74fb6-1963-4f08-9799-f5beb061a6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860b8ed67443467c92b26f353cd56d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:17Z,use_quota=True,user_id='5d8a09dc88894438b7ffd2ba8575107a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0adc981-af4e-46ea-8507-322a9f9a8c3f),volume_type_id=d0adc981-af4e-46ea-8507-322a9f9a8c3f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab736372-585e-4133-b5a3-04a4f13e74c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab736372-585e-4133-b5a3-04a4f13e74c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdef852-e64b-4fa0-bc30-f673032ee255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:04:17 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7" returned: 0 in 0.353s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:17 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 is being set with open permissions: ugo+rw Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:17 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 Aug 24 10:04:17 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdef852-e64b-4fa0-bc30-f673032ee255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dff74fb6-1963-4f08-9799-f5beb061a6e5', 'volume_name': 'volume-dff74fb6-1963-4f08-9799-f5beb061a6e5', 'volume_size': 1, 'image_id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c35f8750ae021459960517f0b46d6b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '860b8ed67443467c92b26f353cd56d44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e14428c73dbd3ca3fb2b69ad1f48a0c376316ca495637d217a8fdf081513a620465f604332c0b3abd42b593a520fe7eb58ceb977144a64e50d8467ea0781b99', 'id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'created_at': datetime.datetime(2026, 8, 24, 8, 4, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 4, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7fcb3c-c7ca-4766-8e92-33eb10195d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7fcb3c-c7ca-4766-8e92-33eb10195d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e4c1dd-4ff2-42dd-bd4f-8e0219c18a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:17 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Volume dff74fb6-1963-4f08-9799-f5beb061a6e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dff74fb6-1963-4f08-9799-f5beb061a6e5', 'volume_size': 1, 'image_id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c35f8750ae021459960517f0b46d6b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '860b8ed67443467c92b26f353cd56d44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e14428c73dbd3ca3fb2b69ad1f48a0c376316ca495637d217a8fdf081513a620465f604332c0b3abd42b593a520fe7eb58ceb977144a64e50d8467ea0781b99', 'id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'created_at': datetime.datetime(2026, 8, 24, 8, 4, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 4, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Trying to clone dff74fb6-1963-4f08-9799-f5beb061a6e5 from image f16a58f7-9bb6-479e-be9d-1c029c5964ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:04:17 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Image download 0.00 MB at 0.00 MB/s Aug 24 10:04:17 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3b87f1-3df8-4c1e-8625-86dd427dfbb8]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:17 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info Aug 24 10:04:17 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:17 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD Aug 24 10:04:17 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:18 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:18 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info is being set with open permissions: ugo+rw Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:18 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info Aug 24 10:04:18 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:18 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:18 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.info" returned: 0 in 0.270s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-8450dc4c-a32a-4d88-8cc8-21924f088731" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:18 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD Aug 24 10:04:18 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-8450dc4c-a32a-4d88-8cc8-21924f088731" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] snapshot: 9a195d3d-c2ca-4375-9746-ba8de8b966a7, volume: 8450dc4c-a32a-4d88-8cc8-21924f088731, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93be682a-0eb7-4ff4-9bd5-df9658a873d9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:18 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 Aug 24 10:04:18 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:18 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Temporary image f16a58f7-9bb6-479e-be9d-1c029c5964ae is fetched for user 5d8a09dc88894438b7ffd2ba8575107a. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e3ad64-ea37-4804-8852-93b4e859e5ed]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:18 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7" returned: 0 in 0.378s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16b99b59-f110-44e0-b9fd-79e5be987ad7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:04:18 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD Aug 24 10:04:18 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b20e1eb-014b-4472-bd3f-9fbd792f2486]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:18 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 Aug 24 10:04:18 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:19 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:19 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD Aug 24 10:04:19 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:19 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7" returned: 0 in 0.452s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:19 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 Aug 24 10:04:19 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:19 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD" returned: 1 in 0.363s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:04:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:24 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731" returned: 0 in 5.126s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:04:24 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Converted 1024.00 MB image at 199.75 MB/s Aug 24 10:04:24 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 is being set with open permissions: ugo+rw Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:24 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 Aug 24 10:04:24 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:24 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731" returned: 0 in 0.268s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-8450dc4c-a32a-4d88-8cc8-21924f088731" released by "_copy_volume_from_snapshot" :: held 6.305s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-9a195d3d-c2ca-4375-9746-ba8de8b966a7" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-9a195d3d-c2ca-4375-9746-ba8de8b966a7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Deleting offline snapshot 9a195d3d-c2ca-4375-9746-ba8de8b966a7 of volume 16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] snapshot_file for this snap is: volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f42ac-2448-485e-a4df-495e11889c82]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:24 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 Aug 24 10:04:24 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:25 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7" returned: 0 in 0.403s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16b99b59-f110-44e0-b9fd-79e5be987ad7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:04:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5608426-0808-4a04-883f-1725b7204a93]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:25 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 Aug 24 10:04:25 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:25 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7" returned: 0 in 0.562s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:25 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 Aug 24 10:04:25 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:26 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7" returned: 0 in 0.384s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:26 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7 Aug 24 10:04:26 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:26 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:26 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:26 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7.9a195d3d-c2ca-4375-9746-ba8de8b966a7" returned: 0 in 0.273s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-9a195d3d-c2ca-4375-9746-ba8de8b966a7" released by "_delete_snapshot" :: held 1.742s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.365s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.178s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1796690721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3943653-5166-4d7f-90dd-a529e0d2b8f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3602c911e0d94a80b4dc264d8202783e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:16Z,use_quota=True,user_id='434d693453cb427a96abb11ddd8cd893',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Creating volume a3943653-5166-4d7f-90dd-a529e0d2b8f6 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:26 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:26 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.288s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:26 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 1073741824 Aug 24 10:04:26 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dfed5a-316d-4517-bbab-f05b4c1df0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8450dc4c-a32a-4d88-8cc8-21924f088731', 'volume_size': 1, 'source_volid': '16b99b59-f110-44e0-b9fd-79e5be987ad7', 'source_volstatus': 'available'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d8d7cd-8148-4681-8b33-3ccaad7c53af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:04:26 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Volume volume-8450dc4c-a32a-4d88-8cc8-21924f088731 (8450dc4c-a32a-4d88-8cc8-21924f088731): created successfully Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d8d7cd-8148-4681-8b33-3ccaad7c53af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (30433209-63f3-49a6-afb5-fa80da0ce438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9ac8833c-0058-4ab2-8276-cc027b23afb1 tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:27 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 1073741824" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:27 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 Aug 24 10:04:27 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:27 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6" returned: 0 in 0.306s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.028s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff74fb6-1963-4f08-9799-f5beb061a6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860b8ed67443467c92b26f353cd56d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:17Z,use_quota=True,user_id='5d8a09dc88894438b7ffd2ba8575107a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0adc981-af4e-46ea-8507-322a9f9a8c3f),volume_type_id=d0adc981-af4e-46ea-8507-322a9f9a8c3f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Creating volume dff74fb6-1963-4f08-9799-f5beb061a6e5 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:27 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510e4fa8-4061-4585-b7cd-061159540f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b1f4e4-2506-4b6e-ad44-0ef03b3377d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:27 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 1073741824 Aug 24 10:04:27 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:27 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Volume volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 (a3943653-5166-4d7f-90dd-a529e0d2b8f6): created successfully Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b1f4e4-2506-4b6e-ad44-0ef03b3377d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Flow 'volume_create_manager' (9fd80345-4f5b-4148-8d0f-74265fdb9090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5bacccd7-a167-432e-8d27-378741ba827e tempest-VolumesTransfersTest-483201948 None] Created volume successfully. Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (5ed9fa9f-11af-4d6f-b20c-57f950ad1c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14abebff-ccfb-4f61-be98-b6b39cc589a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14abebff-ccfb-4f61-be98-b6b39cc589a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-102050951',display_name='tempest-VolumesGetTest-Volume-264673760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:28Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6a920d-2fe8-4749-9d1d-7d725bf81977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6a920d-2fe8-4749-9d1d-7d725bf81977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd8c950-e10b-4732-84e5-249f2087ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd8c950-e10b-4732-84e5-249f2087ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2', 'volume_name': 'volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e920a0-cd42-46df-882f-805ee9fd5a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e920a0-cd42-46df-882f-805ee9fd5a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fcbfeb-7fd6-4936-9270-7ce71589ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:27 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Volume a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2', 'volume_size': 1} Aug 24 10:04:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:28 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 1073741824" returned: 0 in 0.580s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:28 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 Aug 24 10:04:28 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:28 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5" returned: 0 in 0.282s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-102050951',display_name='tempest-VolumesGetTest-Volume-264673760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:28Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Creating volume a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:28 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:28 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 1073741824 Aug 24 10:04:28 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Attempting download of f16a58f7-9bb6-479e-be9d-1c029c5964ae ((None, [{'url': 'file:///opt/stack/data/glance/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'metadata': {}}])) to volume dff74fb6-1963-4f08-9799-f5beb061a6e5. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Acquiring lock "cinder-a3943653-5166-4d7f-90dd-a529e0d2b8f6-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Lock "cinder-a3943653-5166-4d7f-90dd-a529e0d2b8f6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7219f0a-7994-4627-881a-eddf14fa8007]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Acquiring lock "cinder-quobyte-a3943653-5166-4d7f-90dd-a529e0d2b8f6" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Lock "cinder-quobyte-a3943653-5166-4d7f-90dd-a529e0d2b8f6" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:28 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r Aug 24 10:04:28 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4edd5f-b417-444a-a53a-986f89edc68c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:28 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 Aug 24 10:04:28 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:28 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r" returned: 0 in 0.483s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:29 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 1073741824" returned: 0 in 0.737s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:29 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r Aug 24 10:04:29 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:29 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 Aug 24 10:04:29 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:29 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6" returned: 0 in 0.685s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:29 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6 Aug 24 10:04:29 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:29 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r" returned: 1 in 0.427s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f16a58f7-9bb6-479e-be9d-1c029c5964ae_zpq66s0r' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[783a3828-b021-452f-a92b-2b1a61304cf0]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:29 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2" returned: 0 in 0.327s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fcbfeb-7fd6-4936-9270-7ce71589ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01820488-3685-4206-89c5-20a2d6870c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:29 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Volume volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 (a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2): created successfully Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01820488-3685-4206-89c5-20a2d6870c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (5ed9fa9f-11af-4d6f-b20c-57f950ad1c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e84b8c11-60cb-4c4b-9d8a-34fa4e9de4da tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:29 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD Aug 24 10:04:29 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:29 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a3943653-5166-4d7f-90dd-a529e0d2b8f6" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Lock "cinder-quobyte-a3943653-5166-4d7f-90dd-a529e0d2b8f6" released by "delete_volume" :: held 1.117s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Created reservations ['3b9f71f6-a5e1-431e-b25e-a2e59af16a4c', 'f7fadf59-0eca-4d24-80db-821b475c2883', '9aeec9bc-c945-453b-a6c8-9e94167ea8fc', '7d9f78a0-1b27-43cb-ac1b-ce45490b751a'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:29 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:29 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:29 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:29 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD Aug 24 10:04:29 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Lock "cinder-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:30 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.335s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Deleted volume successfully. Aug 24 10:04:30 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD" returned: 1 in 0.440s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] f16a58f7-9bb6-479e-be9d-1c029c5964ae was raw, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7602f9-5bf8-4fd9-9eed-38e100d18b34]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:30 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 Aug 24 10:04:30 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9a254d87-61cc-4ec7-a5b3-0838ebcc7991 tempest-VolumesTransfersTest-903893753 None] Lock "cinder-a3943653-5166-4d7f-90dd-a529e0d2b8f6-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:30 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 Aug 24 10:04:30 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:30 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2" returned: 0 in 0.410s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:30 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2 Aug 24 10:04:30 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:30 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5" returned: 0 in 0.540s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f16a58f7-9bb6-479e-be9d-1c029c5964ae_ys7lu_04devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:04:30 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Converted 0.00 MB image at 0.00 MB/s Aug 24 10:04:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:30 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 1G Aug 24 10:04:30 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:31 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2" returned: 0 in 0.345s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2" released by "delete_volume" :: held 0.833s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Created reservations ['52bacf7a-b72d-421f-90f8-d6bc97d442d5', '0994be33-4905-4464-a965-e87be9233f01', '99c66b98-91ae-4440-a0c3-928672f26e24', 'bbdf0cb3-3535-45dc-8b4c-6dd739054cc8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:31 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 1G" returned: 0 in 0.445s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Downloaded image f16a58f7-9bb6-479e-be9d-1c029c5964ae ((None, [{'url': 'file:///opt/stack/data/glance/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'metadata': {}}])) to volume dff74fb6-1963-4f08-9799-f5beb061a6e5 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Temporary image f16a58f7-9bb6-479e-be9d-1c029c5964ae for user 5d8a09dc88894438b7ffd2ba8575107a is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Marking volume dff74fb6-1963-4f08-9799-f5beb061a6e5 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:04:31 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Copying metadata from image f16a58f7-9bb6-479e-be9d-1c029c5964ae to dff74fb6-1963-4f08-9799-f5beb061a6e5. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Creating volume glance metadata for volume dff74fb6-1963-4f08-9799-f5beb061a6e5 backed by image f16a58f7-9bb6-479e-be9d-1c029c5964ae with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3c35f8750ae021459960517f0b46d6b7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:04:31 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e4c1dd-4ff2-42dd-bd4f-8e0219c18a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff74fb6-1963-4f08-9799-f5beb061a6e5', 'volume_size': 1, 'image_id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3c35f8750ae021459960517f0b46d6b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '860b8ed67443467c92b26f353cd56d44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e14428c73dbd3ca3fb2b69ad1f48a0c376316ca495637d217a8fdf081513a620465f604332c0b3abd42b593a520fe7eb58ceb977144a64e50d8467ea0781b99', 'id': 'f16a58f7-9bb6-479e-be9d-1c029c5964ae', 'created_at': datetime.datetime(2026, 8, 24, 8, 4, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 4, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f16a58f7-9bb6-479e-be9d-1c029c5964ae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b48502-3933-4d1d-9e48-8963232b436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-8450dc4c-a32a-4d88-8cc8-21924f088731-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:31 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Volume volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 (dff74fb6-1963-4f08-9799-f5beb061a6e5): created successfully Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b48502-3933-4d1d-9e48-8963232b436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Flow 'volume_create_manager' (63cc1615-140a-48ae-abae-f03afde2919d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Lock "cinder-8450dc4c-a32a-4d88-8cc8-21924f088731-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-044cb6f4-a304-4e59-b602-c440fc12f99e tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Created volume successfully. Aug 24 10:04:31 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-8450dc4c-a32a-4d88-8cc8-21924f088731" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-8450dc4c-a32a-4d88-8cc8-21924f088731" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e6a3c98-c39b-49b9-86ad-98bb396cd71f tempest-VolumesGetTest-1802578684 None] Lock "cinder-a7cffbf7-86f9-4eb0-adbb-3de2e7af7fb2-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[560eb464-fcce-4941-a13e-cb1a79dab5c9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:31 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 Aug 24 10:04:31 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:32 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731" returned: 0 in 0.455s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:32 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731 Aug 24 10:04:32 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:32 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8450dc4c-a32a-4d88-8cc8-21924f088731" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-8450dc4c-a32a-4d88-8cc8-21924f088731" released by "delete_volume" :: held 0.821s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Created reservations ['c7c4f3ca-bbad-4a70-a445-55721824c67e', 'c6226f73-5529-4c5f-9b18-1ae19af1e79b', '870a2af5-14e1-4cd7-a814-b68e207c6ff2', 'a1011765-5eb4-4a43-a591-94798fcc0af7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Acquiring lock "cinder-dff74fb6-1963-4f08-9799-f5beb061a6e5-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "cinder-dff74fb6-1963-4f08-9799-f5beb061a6e5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:32 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:32 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Acquiring lock "cinder-quobyte-dff74fb6-1963-4f08-9799-f5beb061a6e5" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "cinder-quobyte-dff74fb6-1963-4f08-9799-f5beb061a6e5" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-16b99b59-f110-44e0-b9fd-79e5be987ad7-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b383a20-5481-490c-be86-7a1eca92300a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Lock "cinder-16b99b59-f110-44e0-b9fd-79e5be987ad7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-16b99b59-f110-44e0-b9fd-79e5be987ad7" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-16b99b59-f110-44e0-b9fd-79e5be987ad7" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e56f81-ce60-4447-8ef6-fe20c8683133]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:33 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 Aug 24 10:04:33 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:33 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.462s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:33 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 Aug 24 10:04:33 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c033a8ea-311d-4ef0-8e57-c4d27ac19c75 tempest-VolumesGetTest-1802578684 None] Lock "cinder-8450dc4c-a32a-4d88-8cc8-21924f088731-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:33 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5" returned: 0 in 0.630s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:33 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5 Aug 24 10:04:33 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:33 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7" returned: 0 in 0.512s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:33 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7 Aug 24 10:04:33 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:33 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dff74fb6-1963-4f08-9799-f5beb061a6e5" returned: 0 in 0.352s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "cinder-quobyte-dff74fb6-1963-4f08-9799-f5beb061a6e5" released by "delete_volume" :: held 1.075s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:33 devstack cinder-volume[94039]: WARNING cinder.quota [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:04:33 devstack cinder-volume[94039]: WARNING cinder.quota [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:04:33 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-16b99b59-f110-44e0-b9fd-79e5be987ad7" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Created reservations ['16bc8882-b6f1-4936-b006-4cd5a06c32a8', '6ac7684a-f44d-4a36-a175-93edfcfc6740', '072655bb-7798-4830-afcd-d189d6caece3', '7c83bed7-310e-4ce6-a472-2b860e94c9c7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-16b99b59-f110-44e0-b9fd-79e5be987ad7" released by "delete_volume" :: held 1.015s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Created reservations ['cbbd2b0b-9474-4b2b-b5fc-a6e7ca6eaed4', '4d36ef27-e8d5-407f-b690-bfe649cb6703', 'b6061415-4cb3-4b5d-8ad2-894ab567af73', 'ab8123cd-b8eb-4a36-b872-279502212f73'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:34 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:34 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:34 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:34 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:34 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Deleted volume successfully. Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c84ef2f5-1e4c-48f1-8cbb-6b218221a298 tempest-VolumeAndVolumeTypeFromImageTest-681487724 None] Lock "cinder-dff74fb6-1963-4f08-9799-f5beb061a6e5-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:34 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.326s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7ee80b38-5a43-429e-8212-12d4f2038b46 tempest-VolumesGetTest-1802578684 None] Lock "cinder-16b99b59-f110-44e0-b9fd-79e5be987ad7-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (d96e9127-31f5-4f7c-8236-321d5d5f7dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1bf31b-7af7-442c-be81-40b43658b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1bf31b-7af7-442c-be81-40b43658b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-56657982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e65138-3556-437d-864f-0ab8a79bbc18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:36Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac083af-2336-4f04-87e8-469794c9d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac083af-2336-4f04-87e8-469794c9d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a039c8ce-1a5d-4955-8d8b-1063a77d947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a039c8ce-1a5d-4955-8d8b-1063a77d947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76e65138-3556-437d-864f-0ab8a79bbc18', 'volume_name': 'volume-76e65138-3556-437d-864f-0ab8a79bbc18', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ff4d20-dbc0-4557-9210-4452da9bc447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ff4d20-dbc0-4557-9210-4452da9bc447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f5906a-102e-4551-8c4f-2479fa17e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:36 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Volume 76e65138-3556-437d-864f-0ab8a79bbc18: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76e65138-3556-437d-864f-0ab8a79bbc18', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 24 10:04:36 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Trying to clone 76e65138-3556-437d-864f-0ab8a79bbc18 from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:04:37 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Image download 20.69 MB at 20.69 MB/s Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef783418-b9ba-4be7-af3a-641ca2866e56]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:37 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD Aug 24 10:04:37 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:37 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 is fetched for user 0037b564a3e047eca0bd9027a4ca86ae. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5220360-c8a0-4799-9706-6a84df89d58f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:38 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD Aug 24 10:04:38 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:38 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-56657982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e65138-3556-437d-864f-0ab8a79bbc18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:36Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Creating volume 76e65138-3556-437d-864f-0ab8a79bbc18 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:38 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:38 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 1073741824 Aug 24 10:04:38 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Flow 'volume_create_manager' (5b66557c-dfdc-4d16-8644-b8ccd982563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7295548d-97f3-4d6b-b609-126811f83d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7295548d-97f3-4d6b-b609-126811f83d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1380856785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1258efe4-b7c2-46c3-8580-18f9d334b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57417d2416384b789f0b3e7e018eba19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:39Z,use_quota=True,user_id='55fd6359d01e40229e6795f36d4f3e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ace67fa-3fe5-45f8-add0-02cd8c3f932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ace67fa-3fe5-45f8-add0-02cd8c3f932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df5fe50-a865-430c-a1af-9dba35dd3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:38 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:04:39 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 1073741824" returned: 0 in 0.707s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:39 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 Aug 24 10:04:39 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:39 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df5fe50-a865-430c-a1af-9dba35dd3568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1258efe4-b7c2-46c3-8580-18f9d334b960', 'volume_name': 'volume-1258efe4-b7c2-46c3-8580-18f9d334b960', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cad109-45f2-435f-9282-adcf37c6fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cad109-45f2-435f-9282-adcf37c6fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf62d87b-d058-4a33-acc2-021c5ecf582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:39 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Volume 1258efe4-b7c2-46c3-8580-18f9d334b960: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1258efe4-b7c2-46c3-8580-18f9d334b960', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Trying to clone 1258efe4-b7c2-46c3-8580-18f9d334b960 from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Attempting download of 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 76e65138-3556-437d-864f-0ab8a79bbc18. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf3648-f762-436c-82d7-3844a90986ce]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:39 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0 Aug 24 10:04:39 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:04:40 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Image download 20.69 MB at 20.69 MB/s Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aea480-81cf-4e40-a61f-0bcb63ac8326]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:40 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0" returned: 0 in 0.522s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:40 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD Aug 24 10:04:40 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:40 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0 Aug 24 10:04:40 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:40 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 is fetched for user 55fd6359d01e40229e6795f36d4f3e1b. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[81554841-dbd6-4508-b76a-0417d8fa8839]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:40 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0" returned: 1 in 0.467s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_re83zfo0' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f178ee-eb99-42fe-a300-149b3e0fe10f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:40 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD Aug 24 10:04:40 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:40 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD Aug 24 10:04:40 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:41 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD" returned: 0 in 0.508s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1380856785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1258efe4-b7c2-46c3-8580-18f9d334b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57417d2416384b789f0b3e7e018eba19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:39Z,use_quota=True,user_id='55fd6359d01e40229e6795f36d4f3e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Creating volume 1258efe4-b7c2-46c3-8580-18f9d334b960 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:41 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:41 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] 75b0df00-ae63-45cf-a244-f0a90610f6d1 was qcow2, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:41 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 1073741824 Aug 24 10:04:41 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:41 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 Aug 24 10:04:41 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:41 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 1073741824" returned: 0 in 0.556s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:41 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 Aug 24 10:04:41 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (1133e888-b43d-4d30-9aa0-1391eed03430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:41 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad82d25-dfea-44e8-9b0e-11e441639a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad82d25-dfea-44e8-9b0e-11e441639a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151918052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596dfef8-3b67-4186-9edd-64ebfcdbf864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:42Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e9a35c-9bb7-411f-8162-c6d218b4bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e9a35c-9bb7-411f-8162-c6d218b4bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5af7180-18b9-4b54-9d74-cd0707087c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5af7180-18b9-4b54-9d74-cd0707087c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596dfef8-3b67-4186-9edd-64ebfcdbf864', 'volume_name': 'volume-596dfef8-3b67-4186-9edd-64ebfcdbf864', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63ee302-9576-4afa-99b7-2c85cf7da1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63ee302-9576-4afa-99b7-2c85cf7da1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c35810-f518-4ac4-b714-868c5dbe567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:42 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume 596dfef8-3b67-4186-9edd-64ebfcdbf864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596dfef8-3b67-4186-9edd-64ebfcdbf864', 'volume_size': 1} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:42 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960" returned: 0 in 0.426s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1151918052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596dfef8-3b67-4186-9edd-64ebfcdbf864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:42Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Creating volume 596dfef8-3b67-4186-9edd-64ebfcdbf864 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:42 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Attempting download of 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 1258efe4-b7c2-46c3-8580-18f9d334b960. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:04:42 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 1073741824 Aug 24 10:04:42 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[29118e05-d2fd-4ba0-90b8-20572b33f622]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:42 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a Aug 24 10:04:42 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:42 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a" returned: 0 in 0.411s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:42 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 1073741824" returned: 0 in 0.701s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:42 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a Aug 24 10:04:42 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:42 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 Aug 24 10:04:42 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:43 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a" returned: 1 in 0.484s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_8ke6fm_a' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea59e122-cfbd-4ca6-81cf-cba381e58378]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:43 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864" returned: 0 in 0.308s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c35810-f518-4ac4-b714-868c5dbe567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596dfef8-3b67-4186-9edd-64ebfcdbf864', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876b1475-987a-495b-a729-8511facfe483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 (596dfef8-3b67-4186-9edd-64ebfcdbf864): created successfully Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876b1475-987a-495b-a729-8511facfe483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (1133e888-b43d-4d30-9aa0-1391eed03430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ca8e38bd-b8e4-466b-9927-ccb54971c6f2 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created volume successfully. Aug 24 10:04:43 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD Aug 24 10:04:43 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:43 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18" returned: 0 in 2.373s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_y3x_xl3fdevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:04:43 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Converted 112.00 MB image at 47.16 MB/s Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:43 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 1G Aug 24 10:04:43 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:43 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD" returned: 0 in 0.387s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] 75b0df00-ae63-45cf-a244-f0a90610f6d1 was qcow2, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:43 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 Aug 24 10:04:43 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:43 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 1G" returned: 0 in 0.368s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Downloaded image 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 76e65138-3556-437d-864f-0ab8a79bbc18 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 for user 0037b564a3e047eca0bd9027a4ca86ae is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Marking volume 76e65138-3556-437d-864f-0ab8a79bbc18 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Copying metadata from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 to 76e65138-3556-437d-864f-0ab8a79bbc18. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:04:43 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Creating volume glance metadata for volume 76e65138-3556-437d-864f-0ab8a79bbc18 backed by image 75b0df00-ae63-45cf-a244-f0a90610f6d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f5906a-102e-4551-8c4f-2479fa17e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e65138-3556-437d-864f-0ab8a79bbc18', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce489eb5-41c3-4183-83f0-fb2e4e9eb42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Volume volume-76e65138-3556-437d-864f-0ab8a79bbc18 (76e65138-3556-437d-864f-0ab8a79bbc18): created successfully Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce489eb5-41c3-4183-83f0-fb2e4e9eb42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (d96e9127-31f5-4f7c-8236-321d5d5f7dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f6f57484-90e2-467a-ae04-813b3559bbb8 tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (e8bf23a0-30c0-444f-b631-d7420b8fa3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f92361-93d9-4fd5-850b-733ac12b3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f92361-93d9-4fd5-850b-733ac12b3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-912719015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e15129-ee36-4103-90d3-2ec577d548fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:45Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b88736-2b25-42b9-b872-1d0389a7f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b88736-2b25-42b9-b872-1d0389a7f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54358e18-625f-41d7-8c2c-84b213bdbb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54358e18-625f-41d7-8c2c-84b213bdbb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e15129-ee36-4103-90d3-2ec577d548fc', 'volume_name': 'volume-48e15129-ee36-4103-90d3-2ec577d548fc', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04e304c-e7a9-4958-8ed4-e2611834a9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04e304c-e7a9-4958-8ed4-e2611834a9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7552dd-552e-4bc8-9854-2e1ca43949f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:44 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume 48e15129-ee36-4103-90d3-2ec577d548fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e15129-ee36-4103-90d3-2ec577d548fc', 'volume_size': 1} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-912719015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e15129-ee36-4103-90d3-2ec577d548fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:45Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Creating volume 48e15129-ee36-4103-90d3-2ec577d548fc {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:44 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:44 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc 1073741824 Aug 24 10:04:44 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (f7c76fc6-1cb9-43b4-bf84-53bf75589a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6876365-cb27-41f6-984e-4ee073e9d4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6876365-cb27-41f6-984e-4ee073e9d4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199024795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5661afb-cd15-40a6-b43f-dd39d2bee291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:45Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f40e919-c047-45a0-b96c-085c161ffa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f40e919-c047-45a0-b96c-085c161ffa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7f6378-7970-4e34-997a-dbfc7ff4deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7f6378-7970-4e34-997a-dbfc7ff4deda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5661afb-cd15-40a6-b43f-dd39d2bee291', 'volume_name': 'volume-b5661afb-cd15-40a6-b43f-dd39d2bee291', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3a683d-dd47-463a-b1cb-50953c1b7463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3a683d-dd47-463a-b1cb-50953c1b7463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621821b6-ef61-40e9-97be-fb8021d62b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:45 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume b5661afb-cd15-40a6-b43f-dd39d2bee291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5661afb-cd15-40a6-b43f-dd39d2bee291', 'volume_size': 1} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:45 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc 1073741824" returned: 0 in 1.025s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:46 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc Aug 24 10:04:46 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:46 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960" returned: 0 in 2.942s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_hon2t2o9devstack@QuobyteHD, size 112.00 MB, duration 2.94 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:04:46 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Converted 112.00 MB image at 38.06 MB/s Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:46 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc" returned: 0 in 0.545s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199024795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5661afb-cd15-40a6-b43f-dd39d2bee291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:45Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Creating volume b5661afb-cd15-40a6-b43f-dd39d2bee291 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:46 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:46 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 1G Aug 24 10:04:46 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:46 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 1073741824 Aug 24 10:04:46 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7552dd-552e-4bc8-9854-2e1ca43949f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e15129-ee36-4103-90d3-2ec577d548fc', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fff207e-76b0-46c5-9680-9f8895707493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:46 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume volume-48e15129-ee36-4103-90d3-2ec577d548fc (48e15129-ee36-4103-90d3-2ec577d548fc): created successfully Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fff207e-76b0-46c5-9680-9f8895707493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (e8bf23a0-30c0-444f-b631-d7420b8fa3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6c78d852-9956-43f9-9b8b-5203bbe68eb4 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created volume successfully. Aug 24 10:04:47 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 1G" returned: 0 in 0.591s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Downloaded image 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 1258efe4-b7c2-46c3-8580-18f9d334b960 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 for user 55fd6359d01e40229e6795f36d4f3e1b is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Marking volume 1258efe4-b7c2-46c3-8580-18f9d334b960 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Copying metadata from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 to 1258efe4-b7c2-46c3-8580-18f9d334b960. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Creating volume glance metadata for volume 1258efe4-b7c2-46c3-8580-18f9d334b960 backed by image 75b0df00-ae63-45cf-a244-f0a90610f6d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:47 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (6d6a4642-13b9-4361-b2f7-681becaa5aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2f2204-8a80-4671-8140-590f371d4090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 1073741824" returned: 0 in 0.768s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2f2204-8a80-4671-8140-590f371d4090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972663463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd8a25d-de76-4422-9359-145704d88cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:47Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61d5857-9f57-4e4e-9518-52d86d93ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61d5857-9f57-4e4e-9518-52d86d93ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9451700-fcbe-4914-9e4f-1707f3585c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9451700-fcbe-4914-9e4f-1707f3585c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd8a25d-de76-4422-9359-145704d88cb4', 'volume_name': 'volume-2dd8a25d-de76-4422-9359-145704d88cb4', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19615542-fa15-4c28-8eda-536c2c23fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19615542-fa15-4c28-8eda-536c2c23fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6233be-6e7b-40da-9d13-fb5a42cf8528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume 2dd8a25d-de76-4422-9359-145704d88cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd8a25d-de76-4422-9359-145704d88cb4', 'volume_size': 1} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:47 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 Aug 24 10:04:47 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (aede2654-ca4e-41c1-9698-00c97065d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e71b00-1a47-4d49-8b6e-644f0a68ff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf62d87b-d058-4a33-acc2-021c5ecf582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1258efe4-b7c2-46c3-8580-18f9d334b960', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2c1756-b7ee-462f-a67f-7cfb26980454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e71b00-1a47-4d49-8b6e-644f0a68ff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2032057221',display_name='tempest-VolumesGetTest-Volume-1930531233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52f65ef-2608-4676-a63d-42e3e882eb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:47Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489c3cdc-2587-40e4-b2c7-28dd531b2f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489c3cdc-2587-40e4-b2c7-28dd531b2f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5da1b6e-cc7b-40a6-a691-63458e1ffab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5da1b6e-cc7b-40a6-a691-63458e1ffab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52f65ef-2608-4676-a63d-42e3e882eb2f', 'volume_name': 'volume-f52f65ef-2608-4676-a63d-42e3e882eb2f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2676a934-aa2a-427e-a6ee-24ba131dc520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2676a934-aa2a-427e-a6ee-24ba131dc520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbcc566-c7e6-4826-913b-5bb4b588dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Volume f52f65ef-2608-4676-a63d-42e3e882eb2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52f65ef-2608-4676-a63d-42e3e882eb2f', 'volume_size': 1} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Volume volume-1258efe4-b7c2-46c3-8580-18f9d334b960 (1258efe4-b7c2-46c3-8580-18f9d334b960): created successfully Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2c1756-b7ee-462f-a67f-7cfb26980454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Flow 'volume_create_manager' (5b66557c-dfdc-4d16-8644-b8ccd982563c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:47 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (6836f496-3c10-42e4-ad32-9775f76ff61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23508c47-8c32-4818-b63c-0a4a1a5e60ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8c9cf171-6962-4188-8e2b-338984ea1471 tempest-VolumesImageMetadata-401472053 None] Created volume successfully. Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291" returned: 0 in 0.433s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972663463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd8a25d-de76-4422-9359-145704d88cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:47Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Creating volume 2dd8a25d-de76-4422-9359-145704d88cb4 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:47 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23508c47-8c32-4818-b63c-0a4a1a5e60ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293530147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7e2f96-5dc6-4d7d-97de-214cb1e668c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:48Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110a03e5-4183-474d-85c3-60bffe0afbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110a03e5-4183-474d-85c3-60bffe0afbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19be4d5c-36ec-4eb5-9b47-eab162245966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 1073741824 Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19be4d5c-36ec-4eb5-9b47-eab162245966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec7e2f96-5dc6-4d7d-97de-214cb1e668c5', 'volume_name': 'volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b510b93-1c5d-46ce-9733-5ee084c6fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b510b93-1c5d-46ce-9733-5ee084c6fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b062fdf-14fe-405f-a05e-06488bf5a843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume ec7e2f96-5dc6-4d7d-97de-214cb1e668c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5', 'volume_size': 1} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (913bdb8b-12d4-40de-b5cf-ddcd44523d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d205f26e-6bb0-4720-9ac2-0a5fa95271f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621821b6-ef61-40e9-97be-fb8021d62b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5661afb-cd15-40a6-b43f-dd39d2bee291', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317dfb33-1abb-42bf-807b-f7eea4962008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d205f26e-6bb0-4720-9ac2-0a5fa95271f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340585045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:48Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e42c5c-be48-46ff-b165-7ce374c94ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e42c5c-be48-46ff-b165-7ce374c94ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c14944-8af6-479d-baaa-f93fb29cc2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c14944-8af6-479d-baaa-f93fb29cc2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef', 'volume_name': 'volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d631f1d-8b6e-44c2-867b-27bd46976ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d631f1d-8b6e-44c2-867b-27bd46976ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf90ce7-4003-49aa-9621-416c306e2be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume 5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef', 'volume_size': 1} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 (b5661afb-cd15-40a6-b43f-dd39d2bee291): created successfully Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317dfb33-1abb-42bf-807b-f7eea4962008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (f7c76fc6-1cb9-43b4-bf84-53bf75589a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9dd39047-7b3f-4021-9638-d74ddcc09e67 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created volume successfully. Aug 24 10:04:48 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 1073741824" returned: 0 in 0.562s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:48 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 Aug 24 10:04:48 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:48 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4" returned: 0 in 0.319s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2032057221',display_name='tempest-VolumesGetTest-Volume-1930531233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52f65ef-2608-4676-a63d-42e3e882eb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e87212cfca48c6b4040315e557cb2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:47Z,use_quota=True,user_id='0037b564a3e047eca0bd9027a4ca86ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Creating volume f52f65ef-2608-4676-a63d-42e3e882eb2f {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:48 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:48 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f 1073741824 Aug 24 10:04:48 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6233be-6e7b-40da-9d13-fb5a42cf8528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd8a25d-de76-4422-9359-145704d88cb4', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5313de35-ea0d-47ab-8f6a-afa286f12c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:49 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume volume-2dd8a25d-de76-4422-9359-145704d88cb4 (2dd8a25d-de76-4422-9359-145704d88cb4): created successfully Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5313de35-ea0d-47ab-8f6a-afa286f12c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (6d6a4642-13b9-4361-b2f7-681becaa5aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-182834fc-76a6-49f7-8f83-2c615e80ed01 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created volume successfully. Aug 24 10:04:49 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f 1073741824" returned: 0 in 0.554s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=168,cinder:DELETE=13,cinder:INSERT=64,cinder:UPDATE=213 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:INSERT=63,cinder:UPDATE=195,cinder:SELECT=147,cinder:DELETE=21 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Acquiring lock "cinder-1258efe4-b7c2-46c3-8580-18f9d334b960-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:49 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f Aug 24 10:04:49 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Lock "cinder-1258efe4-b7c2-46c3-8580-18f9d334b960-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Acquiring lock "cinder-quobyte-1258efe4-b7c2-46c3-8580-18f9d334b960" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Lock "cinder-quobyte-1258efe4-b7c2-46c3-8580-18f9d334b960" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f685b-f445-4b63-be1c-67bac32e97ae]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:49 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 Aug 24 10:04:49 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:49 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f" returned: 0 in 0.347s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-293530147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec7e2f96-5dc6-4d7d-97de-214cb1e668c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:48Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Creating volume ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:49 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbcc566-c7e6-4826-913b-5bb4b588dc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52f65ef-2608-4676-a63d-42e3e882eb2f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:49 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 1073741824 Aug 24 10:04:49 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95333200-ec03-4a18-bb6a-96625337ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:49 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Volume volume-f52f65ef-2608-4676-a63d-42e3e882eb2f (f52f65ef-2608-4676-a63d-42e3e882eb2f): created successfully Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95333200-ec03-4a18-bb6a-96625337ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:49 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Flow 'volume_create_manager' (aede2654-ca4e-41c1-9698-00c97065d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:49 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-82fbe348-4052-47d0-bbfc-e58e22a3c594 tempest-VolumesGetTest-1802578684 None] Created volume successfully. Aug 24 10:04:50 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960" returned: 0 in 0.509s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:50 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960 Aug 24 10:04:50 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:50 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 1073741824" returned: 0 in 0.528s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:50 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 Aug 24 10:04:50 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:50 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1258efe4-b7c2-46c3-8580-18f9d334b960" returned: 0 in 0.307s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Lock "cinder-quobyte-1258efe4-b7c2-46c3-8580-18f9d334b960" released by "delete_volume" :: held 0.866s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Created reservations ['938a838e-f78b-4fd3-9eef-845d9bd1c51d', 'e7fe83b3-8f3e-4f5d-882a-29e11a64aa08', '6e646474-a906-4f85-92cb-f2d95d57612f', '6b154dc2-a601-450d-86f3-5019c2f31a7b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:50 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5" returned: 0 in 0.282s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340585045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ee713435bec4990bbbfb59f11085350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:48Z,use_quota=True,user_id='4452e5a5c6cd43b89f4486ce259edf56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Creating volume 5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:50 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b062fdf-14fe-405f-a05e-06488bf5a843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:50 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef 1073741824 Aug 24 10:04:50 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dbd35d-bd6c-42ae-bc14-ecf5d0e65bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:50 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 (ec7e2f96-5dc6-4d7d-97de-214cb1e668c5): created successfully Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dbd35d-bd6c-42ae-bc14-ecf5d0e65bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:50 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (6836f496-3c10-42e4-ad32-9775f76ff61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:50 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-f52f65ef-2608-4676-a63d-42e3e882eb2f-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4b511e84-7d4b-4c02-9e56-fe63eb1f305e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created volume successfully. Aug 24 10:04:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Lock "cinder-f52f65ef-2608-4676-a63d-42e3e882eb2f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-f52f65ef-2608-4676-a63d-42e3e882eb2f" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-f52f65ef-2608-4676-a63d-42e3e882eb2f" acquired by "delete_volume" :: waited 0.050s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4616ec47-089d-4b4d-8b08-40e65c0c8335]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:51 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f Aug 24 10:04:51 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:51 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.538s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Deleted volume successfully. Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e49dcfac-5980-4801-91bf-c8949de3a6fd tempest-VolumesImageMetadata-401472053 None] Lock "cinder-1258efe4-b7c2-46c3-8580-18f9d334b960-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:51 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef 1073741824" returned: 0 in 0.775s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:51 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef Aug 24 10:04:51 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:51 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f" returned: 0 in 0.619s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:51 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f Aug 24 10:04:51 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:51 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef" returned: 0 in 0.379s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf90ce7-4003-49aa-9621-416c306e2be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42950040-7939-4397-b573-4f11c76541ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:52 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f52f65ef-2608-4676-a63d-42e3e882eb2f" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:52 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Volume volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef (5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef): created successfully Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42950040-7939-4397-b573-4f11c76541ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Flow 'volume_create_manager' (913bdb8b-12d4-40de-b5cf-ddcd44523d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-f52f65ef-2608-4676-a63d-42e3e882eb2f" released by "delete_volume" :: held 1.004s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5772b6ca-aa09-48d2-ad6f-3c4a73ec2829 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created volume successfully. Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Created reservations ['8aab6275-7d10-4526-b2b0-d1eb2cad7308', 'a1c4d752-162c-40af-85b9-96a218a1c9c2', '0a09de3d-1161-436f-bc6e-e72878eb6c6f', '17bcec79-c808-4823-b9c7-991e51e15c8e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:52 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:52 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:52 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.379s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f71a06d-e407-4b2b-a7d0-3998307bebfe tempest-VolumesGetTest-1802578684 None] Lock "cinder-f52f65ef-2608-4676-a63d-42e3e882eb2f-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-quobyte-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c8355-fdfd-4542-889d-c13b7a3633ac]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:53 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef Aug 24 10:04:53 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-76e65138-3556-437d-864f-0ab8a79bbc18-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Lock "cinder-76e65138-3556-437d-864f-0ab8a79bbc18-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:53 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef" returned: 0 in 0.528s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:53 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef Aug 24 10:04:53 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Acquiring lock "cinder-quobyte-76e65138-3556-437d-864f-0ab8a79bbc18" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-76e65138-3556-437d-864f-0ab8a79bbc18" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c36d881-da08-4f22-a267-5ae51f539c47]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:53 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 Aug 24 10:04:53 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:53 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef" released by "delete_volume" :: held 0.928s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created reservations ['f90e7b1d-b9c1-4c20-aa1b-34084229ad31', 'b61c3440-566d-486a-ba5f-2718d434c864', '40deb593-b479-498d-95bd-7d9c9bc30fc6', '79c5b510-d4fe-4081-b648-a3d0736f9969'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:54 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:54 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:54 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18" returned: 0 in 0.622s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:54 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18 Aug 24 10:04:54 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Flow 'volume_create_manager' (e410b50f-63d4-452e-8154-cfe31d02a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a046452f-ed30-4f42-ab06-b79af790b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:54 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a046452f-ed30-4f42-ab06-b79af790b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-551869078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99f2d28-a245-4a3a-b45a-c86e5f9f0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7b4329c77a451196a365ce3a4eafc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:54Z,use_quota=True,user_id='d7da0db750eb47c29567ddb456fb2ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380b8a89-07bd-4b71-8132-8f65f15d310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380b8a89-07bd-4b71-8132-8f65f15d310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ed95be-af8c-484f-872c-e4e0ffaec711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ed95be-af8c-484f-872c-e4e0ffaec711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99f2d28-a245-4a3a-b45a-c86e5f9f0e22', 'volume_name': 'volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fa4b4d-899d-4c42-94d4-9d121ea68d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7fa4b4d-899d-4c42-94d4-9d121ea68d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360c6065-6f69-4f7c-9f1c-892b039ec3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Volume b99f2d28-a245-4a3a-b45a-c86e5f9f0e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22', 'volume_size': 1} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-551869078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99f2d28-a245-4a3a-b45a-c86e5f9f0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7b4329c77a451196a365ce3a4eafc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:54Z,use_quota=True,user_id='d7da0db750eb47c29567ddb456fb2ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Creating volume b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:54 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.429s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Deleted volume successfully. Aug 24 10:04:54 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 1073741824 Aug 24 10:04:54 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1d45ed9d-5c27-43ad-95dc-1772420343e5 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-5fbbf3e4-dab4-4a9e-92f0-28049dcb5aef-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:54 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-76e65138-3556-437d-864f-0ab8a79bbc18" returned: 0 in 0.321s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Lock "cinder-quobyte-76e65138-3556-437d-864f-0ab8a79bbc18" released by "delete_volume" :: held 1.001s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Created reservations ['4e6f7e83-23cc-4c83-8c8c-b5e29cecdc02', 'd74c001c-a33d-4d18-a418-c9fc664ce100', '4a512341-916c-4ada-b1b7-6d9d075155e9', 'c235628f-c9f1-48c9-8a05-650d4dd00979'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:54 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:54 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:54 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.307s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Deleted volume successfully. Aug 24 10:04:54 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 1073741824" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f19101cf-849d-4395-9925-2d00acbd244c tempest-VolumesGetTest-1802578684 None] Lock "cinder-76e65138-3556-437d-864f-0ab8a79bbc18-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:55 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:04:55 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-quobyte-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0734d3-74d2-4575-b9f6-ae917aba6416]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Flow 'volume_create_manager' (4f7dc1b5-d278-41f5-aab0-f58ba896376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb98a61d-cebb-45c9-bae4-c418f2322d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb98a61d-cebb-45c9-bae4-c418f2322d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1493566380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ee02c5-4944-4033-b714-b4f8d50a26ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428ff7e42b9e451fb5a98e2bc87ea10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:55Z,use_quota=True,user_id='0e4291d6156242db846b19b990550e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c1dcde-7ff7-4188-af54-d25e20ef7dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c1dcde-7ff7-4188-af54-d25e20ef7dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7938513-6e78-44e4-8352-8f602d43a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7938513-6e78-44e4-8352-8f602d43a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ee02c5-4944-4033-b714-b4f8d50a26ab', 'volume_name': 'volume-08ee02c5-4944-4033-b714-b4f8d50a26ab', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0a7906-c95e-47e9-8c01-a22f64779e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0a7906-c95e-47e9-8c01-a22f64779e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:55 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 Aug 24 10:04:55 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89291c74-ada2-41df-995c-1c7db8d3f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:55 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Volume 08ee02c5-4944-4033-b714-b4f8d50a26ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ee02c5-4944-4033-b714-b4f8d50a26ab', 'volume_size': 1} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:55 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.322s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1493566380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ee02c5-4944-4033-b714-b4f8d50a26ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428ff7e42b9e451fb5a98e2bc87ea10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:04:55Z,use_quota=True,user_id='0e4291d6156242db846b19b990550e24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Creating volume 08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:04:55 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360c6065-6f69-4f7c-9f1c-892b039ec3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:55 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab 1073741824 Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a927d59e-725d-4151-945a-592ef7c857d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:55 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:55 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Volume volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 (b99f2d28-a245-4a3a-b45a-c86e5f9f0e22): created successfully Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a927d59e-725d-4151-945a-592ef7c857d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Flow 'volume_create_manager' (e410b50f-63d4-452e-8154-cfe31d02a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e61b720e-09cf-4f97-9ecc-d4f535ccdb5f tempest-VolumesActionsTest-1692002097 None] Created volume successfully. Aug 24 10:04:55 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5" returned: 0 in 0.394s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:55 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5 Aug 24 10:04:55 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:55 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:55 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab 1073741824" returned: 0 in 0.545s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5" returned: 0 in 0.293s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5" released by "delete_volume" :: held 0.745s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:56 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab Aug 24 10:04:56 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created reservations ['ef82256c-1485-419e-8ad6-20fa5fb42299', '210b767f-4ba0-4eed-a848-86b869ea7562', '6d7963a0-b6cc-47e3-bd07-6a235de577cf', '6e6f076b-fb6a-4eca-90ce-2dd8131764d1'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:56 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:56 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-2dd8a25d-de76-4422-9359-145704d88cb4-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-2dd8a25d-de76-4422-9359-145704d88cb4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:56 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab" returned: 0 in 0.442s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89291c74-ada2-41df-995c-1c7db8d3f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ee02c5-4944-4033-b714-b4f8d50a26ab', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7cafdb-25c8-4436-9f9d-617be84310be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-quobyte-2dd8a25d-de76-4422-9359-145704d88cb4" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:56 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Volume volume-08ee02c5-4944-4033-b714-b4f8d50a26ab (08ee02c5-4944-4033-b714-b4f8d50a26ab): created successfully Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7cafdb-25c8-4436-9f9d-617be84310be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Flow 'volume_create_manager' (4f7dc1b5-d278-41f5-aab0-f58ba896376e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:04:56 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.385s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-2dd8a25d-de76-4422-9359-145704d88cb4" acquired by "delete_volume" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:56 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Deleted volume successfully. Aug 24 10:04:56 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ac57e5a5-3289-4fbc-af79-4a268ca85f87 tempest-SnapshotMetadataTestJSON-63311429 None] Created volume successfully. Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa5d69b-c826-487d-b51b-7163e954620d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-acbb1139-63be-46fc-b9e9-8490e9c63bf7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-ec7e2f96-5dc6-4d7d-97de-214cb1e668c5-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:56 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 Aug 24 10:04:56 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:57 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4" returned: 0 in 0.495s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:57 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4 Aug 24 10:04:57 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:57 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2dd8a25d-de76-4422-9359-145704d88cb4" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-2dd8a25d-de76-4422-9359-145704d88cb4" released by "delete_volume" :: held 0.927s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created reservations ['25677bfd-f939-4910-8831-5e6db4857ada', 'cfe7402f-c822-4f6e-be0d-01172dc27ea4', '9ed80074-970b-4630-b9d9-f53b94f20a8e', 'd9744374-684c-4b38-b5df-0056f79b1dd0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:57 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:04:57 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Creating offline snapshot 17bd1817-9d0c-4d8a-88af-bcbdde20cd8a of volume 08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35ffc2-c0c5-4e0a-bd3a-f617601f4887]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:57 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab Aug 24 10:04:57 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:57 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:57 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:04:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Deleted volume successfully. Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-699f3003-ba9c-4195-a5cd-42457a3aa87e tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-2dd8a25d-de76-4422-9359-145704d88cb4-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:58 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab" returned: 0 in 0.499s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:58 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a 1G Aug 24 10:04:58 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-b5661afb-cd15-40a6-b43f-dd39d2bee291-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-b5661afb-cd15-40a6-b43f-dd39d2bee291-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-quobyte-b5661afb-cd15-40a6-b43f-dd39d2bee291" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-b5661afb-cd15-40a6-b43f-dd39d2bee291" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:04:58 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f55aba-641a-4dd9-8d7e-fce57ee971d5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a 1G" returned: 0 in 0.605s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ee02c5-4944-4033-b714-b4f8d50a26ab -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:58 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ee02c5-4944-4033-b714-b4f8d50a26ab -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a Aug 24 10:04:58 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:58 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 Aug 24 10:04:58 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:59 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ee02c5-4944-4033-b714-b4f8d50a26ab -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" returned: 0 in 0.454s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:59 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a is being set with open permissions: ugo+rw Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:59 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a Aug 24 10:04:59 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:59 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291" returned: 0 in 0.523s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:59 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291 Aug 24 10:04:59 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:59 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" returned: 0 in 0.339s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:59 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5661afb-cd15-40a6-b43f-dd39d2bee291" returned: 0 in 0.305s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-b5661afb-cd15-40a6-b43f-dd39d2bee291" released by "delete_volume" :: held 0.903s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:04:59 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info Aug 24 10:04:59 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:04:59 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created reservations ['b6367061-3872-4c37-a689-e41bfb826b73', 'ddf4120e-05ca-4130-8e05-c6d427dc4a60', 'fcb69e37-cc22-4279-89fb-ad92d6bbe8f8', '6fff00ba-b323-40ac-afb8-f8deb1c37353'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:00 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:00 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:00 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info" returned: 0 in 0.492s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:00 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info is being set with open permissions: ugo+rw Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:00 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info Aug 24 10:05:00 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:00 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.491s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Deleted volume successfully. Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-07813909-c1b3-4187-b6a9-c4ec8010b267 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-b5661afb-cd15-40a6-b43f-dd39d2bee291-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:00 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.info" returned: 0 in 0.407s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.936s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-75ff5a0a-a5ec-4244-82fe-a8dd3f5e37b5 tempest-SnapshotMetadataTestJSON-63311429 None] Create snapshot completed successfully Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-48e15129-ee36-4103-90d3-2ec577d548fc-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-48e15129-ee36-4103-90d3-2ec577d548fc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-quobyte-48e15129-ee36-4103-90d3-2ec577d548fc" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-48e15129-ee36-4103-90d3-2ec577d548fc" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd07f6e-832b-415d-9e82-381f1211c1b9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:01 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc Aug 24 10:05:01 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:01 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc" returned: 0 in 0.553s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:01 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc Aug 24 10:05:01 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "cinder-17bd1817-9d0c-4d8a-88af-bcbdde20cd8a-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-17bd1817-9d0c-4d8a-88af-bcbdde20cd8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "cinder-quobyte-08ee02c5-4944-4033-b714-b4f8d50a26ab" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-quobyte-08ee02c5-4944-4033-b714-b4f8d50a26ab" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "cinder-quobyte-17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-quobyte-17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Deleting offline snapshot 17bd1817-9d0c-4d8a-88af-bcbdde20cd8a of volume 08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] snapshot_file for this snap is: volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:05:02 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48e15129-ee36-4103-90d3-2ec577d548fc" returned: 0 in 0.498s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d602f43-3037-4b97-8f7c-0b4ab17e774d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-48e15129-ee36-4103-90d3-2ec577d548fc" released by "delete_volume" :: held 1.113s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created reservations ['38f0a576-0071-4079-bbb6-95a9801b97e4', 'c5f156ba-a354-429e-b3f7-a09752ca678d', 'c31fc25e-f893-40e4-9458-a1d2061b2f44', 'dc44591e-4f11-4301-886f-899cda03b951'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:02 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a Aug 24 10:05:02 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:02 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:02 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:02 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Deleted volume successfully. Aug 24 10:05:02 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" returned: 0 in 0.509s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ee02c5-4944-4033-b714-b4f8d50a26ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764b1e3-8817-4753-be4b-d2cdacbba3bf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7396ac93-7a9d-4d51-8c75-a660091ea6bc tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-48e15129-ee36-4103-90d3-2ec577d548fc-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:03 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab Aug 24 10:05:03 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:03 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab" returned: 0 in 0.445s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:03 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a Aug 24 10:05:03 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-596dfef8-3b67-4186-9edd-64ebfcdbf864-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-596dfef8-3b67-4186-9edd-64ebfcdbf864-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "cinder-quobyte-596dfef8-3b67-4186-9edd-64ebfcdbf864" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-596dfef8-3b67-4186-9edd-64ebfcdbf864" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[799e8e12-6f7f-459b-83e0-2f71ee706f4f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:03 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 Aug 24 10:05:03 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:03 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" returned: 0 in 0.511s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:03 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a Aug 24 10:05:03 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:04 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864" returned: 0 in 0.528s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:04 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864 Aug 24 10:05:04 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:04 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab.17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" returned: 0 in 0.535s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-quobyte-17bd1817-9d0c-4d8a-88af-bcbdde20cd8a" released by "_delete_snapshot" :: held 2.172s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-quobyte-08ee02c5-4944-4033-b714-b4f8d50a26ab" released by "delete_snapshot" :: held 2.205s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:04 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-596dfef8-3b67-4186-9edd-64ebfcdbf864" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Created reservations ['c919736d-9336-4708-b951-7da34ecf34f3', 'e1e96a98-439f-43c1-8757-ae9a54d4a4a5', 'ac3d7689-1d30-42bf-b88f-b53e8e7457c7', '924bedcf-006c-4c68-a7d5-d38cee84f29b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-quobyte-596dfef8-3b67-4186-9edd-64ebfcdbf864" released by "delete_volume" :: held 0.963s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Delete snapshot completed successfully. Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-31e2c12c-bb77-42c4-a7be-4958b9c32417 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-17bd1817-9d0c-4d8a-88af-bcbdde20cd8a-delete_snapshot" released by "delete_snapshot" :: held 2.452s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Created reservations ['54bad819-6a02-4f49-82db-c4a3c067e8df', '92e4a88c-bdc8-4326-a250-f617bb5c0e7d', 'd810b9fa-a90c-413f-8b14-0508ec75e91e', 'c9bd0ed7-8feb-467f-ac17-ea7e20aa6db4'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:04 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:04 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:05 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.607s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Deleted volume successfully. Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-300e29bf-600d-46fc-84eb-3d1d6a6d69b7 tempest-CreateVolumesFromSourceVolumeTest-164738160 None] Lock "cinder-596dfef8-3b67-4186-9edd-64ebfcdbf864-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "cinder-08ee02c5-4944-4033-b714-b4f8d50a26ab-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-08ee02c5-4944-4033-b714-b4f8d50a26ab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "cinder-quobyte-08ee02c5-4944-4033-b714-b4f8d50a26ab" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-quobyte-08ee02c5-4944-4033-b714-b4f8d50a26ab" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af25302-156d-47d1-b70d-1d1bc5cfe7b2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:06 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab Aug 24 10:05:06 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:06 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab" returned: 0 in 0.704s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:06 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab Aug 24 10:05:06 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:07 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-08ee02c5-4944-4033-b714-b4f8d50a26ab" returned: 0 in 0.551s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-quobyte-08ee02c5-4944-4033-b714-b4f8d50a26ab" released by "delete_volume" :: held 1.379s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Created reservations ['b155069f-98ff-49f7-9663-b399d1d4976f', 'd9f25c4a-7155-428a-96cb-897c04d51d9a', 'fae65225-d7de-432f-b4ca-e9af4159f9c0', 'bb70be1c-877c-4042-b875-a28548fb4cea'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:07 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:07 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:07 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.372s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Deleted volume successfully. Aug 24 10:05:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c284607f-a383-4f65-84af-280b42f285d8 tempest-SnapshotMetadataTestJSON-63311429 None] Lock "cinder-08ee02c5-4944-4033-b714-b4f8d50a26ab-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4afdd6d3-173c-454a-ac62-bc41ce1854b3 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" by "attach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4afdd6d3-173c-454a-ac62-bc41ce1854b3 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" acquired by "attach_volume" :: waited 0.076s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Flow 'volume_create_manager' (8721db6b-a34b-4f84-bb9d-abdcd65e3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b85f924-43f4-4efb-9541-3ecd1c91c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b85f924-43f4-4efb-9541-3ecd1c91c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f115c15-5537-4d3f-acea-be6c2ae46b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04ec5ebadc4ce6ac1fd2e001d6e194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:11Z,use_quota=True,user_id='ba919333061b4e9ca814cd832f5471e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64538e7e-66a4-4c47-a900-974c649b58dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64538e7e-66a4-4c47-a900-974c649b58dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46aca0e-820d-43d6-9a55-07a412814ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46aca0e-820d-43d6-9a55-07a412814ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f115c15-5537-4d3f-acea-be6c2ae46b7a', 'volume_name': 'volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73400792-b94d-40a8-8877-620373484294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73400792-b94d-40a8-8877-620373484294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92abf1db-2e3f-4327-931a-a3b114e231be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Volume 6f115c15-5537-4d3f-acea-be6c2ae46b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a', 'volume_size': 1} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f115c15-5537-4d3f-acea-be6c2ae46b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04ec5ebadc4ce6ac1fd2e001d6e194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:11Z,use_quota=True,user_id='ba919333061b4e9ca814cd832f5471e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Creating volume 6f115c15-5537-4d3f-acea-be6c2ae46b7a {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:05:11 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:11 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a 1073741824 Aug 24 10:05:11 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4afdd6d3-173c-454a-ac62-bc41ce1854b3 tempest-VolumesActionsTest-1692002097 None] Attaching volume b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 to instance 7a4e143e-5b21-4c65-a5e9-3933a7d4cb5b at mountpoint /dev/vdb on host None. Aug 24 10:05:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4afdd6d3-173c-454a-ac62-bc41ce1854b3 tempest-VolumesActionsTest-1692002097 None] Attach volume completed successfully. Aug 24 10:05:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4afdd6d3-173c-454a-ac62-bc41ce1854b3 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" released by "attach_volume" :: held 0.662s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad3519aa-226b-44f7-9852-121dc6f285ae tempest-VolumesActionsTest-1692002097 None] Acquiring lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-detach_volume" by "detach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad3519aa-226b-44f7-9852-121dc6f285ae tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ad3519aa-226b-44f7-9852-121dc6f285ae tempest-VolumesActionsTest-1692002097 None] Detaching volume b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 from instance 7a4e143e-5b21-4c65-a5e9-3933a7d4cb5b. Aug 24 10:05:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ad3519aa-226b-44f7-9852-121dc6f285ae tempest-VolumesActionsTest-1692002097 None] Detach volume completed successfully. Aug 24 10:05:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ad3519aa-226b-44f7-9852-121dc6f285ae tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:12 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a 1073741824" returned: 0 in 1.022s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:12 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a Aug 24 10:05:12 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:13 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a" returned: 0 in 0.420s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92abf1db-2e3f-4327-931a-a3b114e231be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b996e5-52eb-468c-aa36-55c51b850640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:13 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Volume volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a (6f115c15-5537-4d3f-acea-be6c2ae46b7a): created successfully Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b996e5-52eb-468c-aa36-55c51b850640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Flow 'volume_create_manager' (8721db6b-a34b-4f84-bb9d-abdcd65e3603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1be1bf54-e08e-4dc6-bd04-9715dcc6fcb6 tempest-CinderUnicodeTest-1622538462 None] Created volume successfully. Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Flow 'volume_create_manager' (33491f81-a10d-4bae-802f-7dbc8fb25933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5106249-cf42-468f-af91-1681bae949b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5106249-cf42-468f-af91-1681bae949b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-228424479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7d5fb7-15fc-4ef1-9500-9cd3d2718873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04ec5ebadc4ce6ac1fd2e001d6e194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:14Z,use_quota=True,user_id='ba919333061b4e9ca814cd832f5471e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46340504-ec11-4574-945b-18eaf6a9b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46340504-ec11-4574-945b-18eaf6a9b62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b21803-9c0a-4a58-af4a-5504404c6805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b21803-9c0a-4a58-af4a-5504404c6805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a7d5fb7-15fc-4ef1-9500-9cd3d2718873', 'volume_name': 'volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a6353-c2c8-4b8e-a487-d97fbcbb5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082a6353-c2c8-4b8e-a487-d97fbcbb5384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b2b77a-a0af-4394-8459-b06138964c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:14 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Volume 9a7d5fb7-15fc-4ef1-9500-9cd3d2718873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873', 'volume_size': 1} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-228424479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7d5fb7-15fc-4ef1-9500-9cd3d2718873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc04ec5ebadc4ce6ac1fd2e001d6e194',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:14Z,use_quota=True,user_id='ba919333061b4e9ca814cd832f5471e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Creating volume 9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:05:14 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:05:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:14 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 1073741824 Aug 24 10:05:14 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:15 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 1073741824" returned: 0 in 0.790s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:15 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 Aug 24 10:05:15 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:15 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b2b77a-a0af-4394-8459-b06138964c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338076d4-f86e-4895-b765-3e4b816e863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:15 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Volume volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 (9a7d5fb7-15fc-4ef1-9500-9cd3d2718873): created successfully Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338076d4-f86e-4895-b765-3e4b816e863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Flow 'volume_create_manager' (33491f81-a10d-4bae-802f-7dbc8fb25933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-44e069a0-42e3-4812-8ea7-1267535d21d3 tempest-CinderUnicodeTest-1622538462 None] Created volume successfully. Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Flow 'volume_create_manager' (2c8773e3-9b9a-4e46-85ee-323640cdc70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290aa241-6c54-4c16-a63d-144e651f7c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290aa241-6c54-4c16-a63d-144e651f7c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-924368304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20f4806-5bfc-4abb-9e19-0a8078cbaa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7474cda4fc364df89b520bb6620bd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:17Z,use_quota=True,user_id='6f26b99543b04518b921fd9babd3f4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a171b7-3dd4-4f50-99e5-f6866cf8fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a171b7-3dd4-4f50-99e5-f6866cf8fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbdef74-9275-4c06-b9c3-7cf05479a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbdef74-9275-4c06-b9c3-7cf05479a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20f4806-5bfc-4abb-9e19-0a8078cbaa5d', 'volume_name': 'volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ff94d7-c0bc-4e1c-84a3-76ccc894e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ff94d7-c0bc-4e1c-84a3-76ccc894e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb12dfb-2075-4e65-b4a5-16f96a339f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Volume b20f4806-5bfc-4abb-9e19-0a8078cbaa5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d', 'volume_size': 1} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-924368304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20f4806-5bfc-4abb-9e19-0a8078cbaa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7474cda4fc364df89b520bb6620bd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:17Z,use_quota=True,user_id='6f26b99543b04518b921fd9babd3f4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Creating volume b20f4806-5bfc-4abb-9e19-0a8078cbaa5d {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:05:16 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:16 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d 1073741824 Aug 24 10:05:16 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:17 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d 1073741824" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:17 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d Aug 24 10:05:17 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:17 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d" returned: 0 in 0.311s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.837s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Creating offline snapshot fe61071b-1f93-4510-9b40-f2c12ef5e145 of volume 9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb12dfb-2075-4e65-b4a5-16f96a339f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42967074-120b-4ff9-9595-54671a9ebba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bafc6f-a539-4203-b5b3-c337d01df717]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:17 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Volume volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d (b20f4806-5bfc-4abb-9e19-0a8078cbaa5d): created successfully Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42967074-120b-4ff9-9595-54671a9ebba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Flow 'volume_create_manager' (2c8773e3-9b9a-4e46-85ee-323640cdc70d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5b88c44c-2849-4e7b-a673-3354960c2c9f tempest-VolumesTransfersV357Test-1620531649 None] Created volume successfully. Aug 24 10:05:18 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 Aug 24 10:05:18 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:18 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" returned: 0 in 0.586s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:18 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 1G Aug 24 10:05:18 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:19 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 1G" returned: 0 in 0.686s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:19 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 Aug 24 10:05:19 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:19 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145" returned: 0 in 0.491s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:19 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 is being set with open permissions: ugo+rw Aug 24 10:05:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:19 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 Aug 24 10:05:19 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8b9ab9b0-51f3-442e-aebc-1ad7f202da90 tempest-VolumesTransfersV357Test-1549713107 None] Transfer volume completed successfully. Aug 24 10:05:20 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145" returned: 0 in 0.445s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:20 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info Aug 24 10:05:20 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:20 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info" returned: 0 in 0.367s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:20 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info is being set with open permissions: ugo+rw Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:20 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info Aug 24 10:05:20 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Acquiring lock "cinder-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Acquiring lock "cinder-quobyte-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-quobyte-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf5a46-7933-44c0-907c-2e0cc6f228fd]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:20 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.info" returned: 0 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d0de26ac-3530-43a3-a988-e7d26c1ee351 tempest-CinderUnicodeTest-1622538462 None] Create snapshot completed successfully Aug 24 10:05:20 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d Aug 24 10:05:20 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-fe61071b-1f93-4510-9b40-f2c12ef5e145-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-fe61071b-1f93-4510-9b40-f2c12ef5e145-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-quobyte-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-quobyte-fe61071b-1f93-4510-9b40-f2c12ef5e145" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:21 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-fe61071b-1f93-4510-9b40-f2c12ef5e145" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Deleting offline snapshot fe61071b-1f93-4510-9b40-f2c12ef5e145 of volume 9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:05:21 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d Aug 24 10:05:21 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] snapshot_file for this snap is: volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e368f-e394-45fe-8649-3d37384ccb85]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:21 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 Aug 24 10:05:21 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:21 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d" returned: 0 in 0.410s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-quobyte-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d" released by "delete_volume" :: held 1.012s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Created reservations ['5496a5e3-9837-4b71-afde-222d0eb0a55c', 'e1189a63-ee28-4c03-8a26-64e70fa96376', 'ad6154bc-54a4-4da7-be74-ef99c339fd98', 'eb1ec64a-088f-410b-8039-81d6b56b8b4c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:21 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145" returned: 0 in 0.559s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e7ec36-e53b-4563-b8d6-52f6ef4f56e0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:22 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:22 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:22 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 Aug 24 10:05:22 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:22 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.674s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Deleted volume successfully. Aug 24 10:05:22 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" returned: 0 in 0.791s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-813d2af7-b381-4d79-a549-e9ec3fb8c37c tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-b20f4806-5bfc-4abb-9e19-0a8078cbaa5d-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:22 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 Aug 24 10:05:22 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:23 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145" returned: 0 in 1.029s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:23 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145 Aug 24 10:05:23 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Flow 'volume_create_manager' (27ce749f-d130-4dc8-aff4-e55eb6492f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0ad7d9-aa0c-4571-89db-d157ef70a9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0ad7d9-aa0c-4571-89db-d157ef70a9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1003260863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bee333-a13c-46b3-a981-e520c4f8696e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7474cda4fc364df89b520bb6620bd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:24Z,use_quota=True,user_id='6f26b99543b04518b921fd9babd3f4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c489e50-46f4-438b-9828-ebb994039daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c489e50-46f4-438b-9828-ebb994039daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd16f40-fd8b-4403-9690-2b37798d6ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd16f40-fd8b-4403-9690-2b37798d6ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bee333-a13c-46b3-a981-e520c4f8696e', 'volume_name': 'volume-96bee333-a13c-46b3-a981-e520c4f8696e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cd9d78-c24c-4e19-9b9b-a37eddf0e9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cd9d78-c24c-4e19-9b9b-a37eddf0e9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beab7cee-b423-465c-ab81-4648a0e59a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Volume 96bee333-a13c-46b3-a981-e520c4f8696e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bee333-a13c-46b3-a981-e520c4f8696e', 'volume_size': 1} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1003260863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bee333-a13c-46b3-a981-e520c4f8696e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7474cda4fc364df89b520bb6620bd4b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:24Z,use_quota=True,user_id='6f26b99543b04518b921fd9babd3f4ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Creating volume 96bee333-a13c-46b3-a981-e520c4f8696e {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:05:24 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:24 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e 1073741824 Aug 24 10:05:24 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:24 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873.fe61071b-1f93-4510-9b40-f2c12ef5e145" returned: 0 in 0.471s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-fe61071b-1f93-4510-9b40-f2c12ef5e145" released by "_delete_snapshot" :: held 3.031s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" released by "delete_snapshot" :: held 3.093s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Created reservations ['54228e11-5c01-479e-a487-5c40199618e5', '4fb1c118-033a-4891-aaa7-eca151d1deb7', 'e6748b83-14e6-46aa-a839-c2c1a47aa46c', '86ddda98-d93a-4732-bfa1-3407cb2c5acf'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Delete snapshot completed successfully. Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02ae892a-11af-4c00-a562-bf4e2a162d6c tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-fe61071b-1f93-4510-9b40-f2c12ef5e145-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:24 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e 1073741824" returned: 0 in 0.721s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:24 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e Aug 24 10:05:24 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:25 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e" returned: 0 in 0.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beab7cee-b423-465c-ab81-4648a0e59a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bee333-a13c-46b3-a981-e520c4f8696e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7763174a-c3fc-4464-b41a-2cacf2a26eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Volume volume-96bee333-a13c-46b3-a981-e520c4f8696e (96bee333-a13c-46b3-a981-e520c4f8696e): created successfully Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7763174a-c3fc-4464-b41a-2cacf2a26eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Flow 'volume_create_manager' (27ce749f-d130-4dc8-aff4-e55eb6492f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-30a30269-e178-49c0-b125-b4fbf4eca42e tempest-VolumesTransfersV357Test-1620531649 None] Created volume successfully. Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-quobyte-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" acquired by "delete_volume" :: waited 0.040s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b9c5c-a1bb-434f-8fc7-7216b9c9ec0a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:26 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:26 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:26 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 Aug 24 10:05:26 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:26 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.463s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:05:26 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" returned: 0 in 0.777s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Acquiring lock "cinder-96bee333-a13c-46b3-a981-e520c4f8696e-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:26 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873 Aug 24 10:05:26 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-96bee333-a13c-46b3-a981-e520c4f8696e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Acquiring lock "cinder-quobyte-96bee333-a13c-46b3-a981-e520c4f8696e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-quobyte-96bee333-a13c-46b3-a981-e520c4f8696e" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b91e2f-940d-4053-8705-b5556f159b17]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:27 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:27 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873" released by "delete_volume" :: held 1.375s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:27 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Created reservations ['e0600f9f-c042-4192-aef4-4631b70b1379', '60c1ea99-bd0c-415b-aae1-da0b13617de8', '3b73df1b-3467-416b-8af0-ac437cdc8f67', '6f3eafa7-c031-4f0a-b4f5-f921f10dbc99'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:27 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:27 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:27 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e" returned: 0 in 0.662s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:27 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e Aug 24 10:05:27 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:27 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.413s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Deleted volume successfully. Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bca7003-d17b-4819-ae44-625d4ed09950 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" by "attach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-913b6321-43ad-439c-8a8d-d1eea80891df tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-9a7d5fb7-15fc-4ef1-9500-9cd3d2718873-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bca7003-d17b-4819-ae44-625d4ed09950 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" acquired by "attach_volume" :: waited 0.073s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2bca7003-d17b-4819-ae44-625d4ed09950 tempest-VolumesActionsTest-1692002097 None] Attaching volume b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 to instance 7256a236-e7c2-464f-af1d-2bfb70ee7ac9 at mountpoint /dev/vdb on host None. Aug 24 10:05:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2bca7003-d17b-4819-ae44-625d4ed09950 tempest-VolumesActionsTest-1692002097 None] Attach volume completed successfully. Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2bca7003-d17b-4819-ae44-625d4ed09950 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" released by "attach_volume" :: held 0.182s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:28 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-96bee333-a13c-46b3-a981-e520c4f8696e" returned: 0 in 0.551s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-6f115c15-5537-4d3f-acea-be6c2ae46b7a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-quobyte-96bee333-a13c-46b3-a981-e520c4f8696e" released by "delete_volume" :: held 1.320s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-6f115c15-5537-4d3f-acea-be6c2ae46b7a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-807dd121-95de-439e-bb19-388a6f146591 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-detach_volume" by "detach_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-807dd121-95de-439e-bb19-388a6f146591 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-807dd121-95de-439e-bb19-388a6f146591 tempest-VolumesActionsTest-1692002097 None] Detaching volume b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 from instance 7256a236-e7c2-464f-af1d-2bfb70ee7ac9. Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "cinder-quobyte-6f115c15-5537-4d3f-acea-be6c2ae46b7a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-6f115c15-5537-4d3f-acea-be6c2ae46b7a" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Created reservations ['d04b155c-7c1e-4708-a1f5-73ba9c50adab', 'df770f3b-17a3-46e0-9810-80ec833dcbd4', 'bd083108-3015-49b9-9847-220d3fecb063', '04ef83e4-ba90-427e-af07-0936b0f48868'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59ceca5-3611-41fd-9943-a2ec4913cc78]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-807dd121-95de-439e-bb19-388a6f146591 tempest-VolumesActionsTest-1692002097 None] Detach volume completed successfully. Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-807dd121-95de-439e-bb19-388a6f146591 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-detach_volume" released by "detach_volume" :: held 0.198s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:28 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:28 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:28 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a Aug 24 10:05:28 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:29 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:29 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.435s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a" returned: 0 in 0.562s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Deleted volume successfully. Aug 24 10:05:29 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a Aug 24 10:05:29 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ec074114-89fd-4317-be44-572bce0c97df tempest-VolumesTransfersV357Test-1979897382 None] Lock "cinder-96bee333-a13c-46b3-a981-e520c4f8696e-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:29 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f115c15-5537-4d3f-acea-be6c2ae46b7a" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-quobyte-6f115c15-5537-4d3f-acea-be6c2ae46b7a" released by "delete_volume" :: held 1.002s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Created reservations ['fda5d2fd-0c6f-4f66-9dc1-39327527c0d1', '947a7d68-28c2-439c-9cb6-18915a2bced7', 'f6683453-9a87-4dee-8427-2ab4a2d0dd38', 'da8067d7-6644-43cb-8620-e6f897f9b0ad'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:05:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:29 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:05:29 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:30 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.387s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:30 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:05:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Deleted volume successfully. Aug 24 10:05:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2522a150-b5d6-4108-a716-4ba0d0b1a8cd tempest-CinderUnicodeTest-1622538462 None] Lock "cinder-6f115c15-5537-4d3f-acea-be6c2ae46b7a-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:05:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:05:34 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3408cfc-57ef-45d8-b996-5ef6090507c7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:34 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:05:34 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:35 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:35 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e93abb8-e53c-47f9-9bf1-93c0598c16e7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:35 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:05:35 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:35 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.602s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.e7808280-8359-4692-896d-35798fa20ee4h6gow37m.img {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:35 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.e7808280-8359-4692-896d-35798fa20ee4h6gow37m.img Aug 24 10:05:35 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=116,cinder:UPDATE=165,cinder:INSERT=45,cinder:DELETE=10 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:05:42 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.e7808280-8359-4692-896d-35798fa20ee4h6gow37m.img" returned: 0 in 6.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:42 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b12e1-6932-4f83-a12a-b8f4b9e07e3e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:42 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:05:42 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:42 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.672s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:42 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.e7808280-8359-4692-896d-35798fa20ee4h6gow37m.img {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:05:42 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Converted 1024.00 MB image at 163.80 MB/s Aug 24 10:05:42 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] e7808280-8359-4692-896d-35798fa20ee4 was raw, no need to convert to raw {{(pid=94039) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Flow 'volume_create_manager' (6d25b547-f6ab-453f-b9d5-40731c157d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74ce8ce-9da2-4e13-923b-b7d5072aa763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74ce8ce-9da2-4e13-923b-b7d5072aa763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1539019680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de63083b87c34b4189a3b55493fb9630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:44Z,use_quota=True,user_id='4f3b9ea68aea4e63a9df55536c24faa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d79045a-9ce2-4bcf-92d3-eb49deb308f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d79045a-9ce2-4bcf-92d3-eb49deb308f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df380f16-effe-45cd-b323-cad41aa27214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df380f16-effe-45cd-b323-cad41aa27214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7', 'volume_name': 'volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b962dfed-4b11-4e79-b0d4-d9631b33d2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b962dfed-4b11-4e79-b0d4-d9631b33d2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055e4df9-057d-49fc-8ce7-4e131f9b1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Volume e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7', 'volume_size': 1} Aug 24 10:05:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (a03d29f9-f04b-408d-aa9c-8cbc28959ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb46530-5ffd-4760-8bf6-a40474e5ca5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb46530-5ffd-4760-8bf6-a40474e5ca5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793887335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c51493-7983-434d-968f-c8c6e8840d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:46Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e3aae2-fb49-48e3-9d6f-6b2b18e9c3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e3aae2-fb49-48e3-9d6f-6b2b18e9c3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e118b84e-ef38-4a06-a1d8-fafab1b6dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e118b84e-ef38-4a06-a1d8-fafab1b6dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c51493-7983-434d-968f-c8c6e8840d3c', 'volume_name': 'volume-c4c51493-7983-434d-968f-c8c6e8840d3c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d018d72e-d8f0-4362-96b9-3e5e1e39dc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d018d72e-d8f0-4362-96b9-3e5e1e39dc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db91199f-2f8b-4873-9460-7bb0115c6067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:46 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Volume c4c51493-7983-434d-968f-c8c6e8840d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c51493-7983-434d-968f-c8c6e8840d3c', 'volume_size': 1} Aug 24 10:05:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Flow 'volume_create_manager' (94aae8e5-4e7e-4c64-8e00-6c18945c7323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44900fe9-da3a-41df-9f74-bdef7f1791e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44900fe9-da3a-41df-9f74-bdef7f1791e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350461668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8283f58d-04c3-4df5-ac3c-c937b1f2de19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638c03d79ee436f9cd2aaf2b33b79e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:47Z,use_quota=True,user_id='5160221a6a47490d9578d5f5d91a4b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0b499dc-1f79-41d5-bab9-10a9273ffef3),volume_type_id=a0b499dc-1f79-41d5-bab9-10a9273ffef3)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dd4001-3c28-46df-8260-8778669dcd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dd4001-3c28-46df-8260-8778669dcd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d5a15b-9b49-4ac4-bdd0-5c1b1d2ea4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d5a15b-9b49-4ac4-bdd0-5c1b1d2ea4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8283f58d-04c3-4df5-ac3c-c937b1f2de19', 'volume_name': 'volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ee5e8b-193e-4e5c-99dc-ace313aa46e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ee5e8b-193e-4e5c-99dc-ace313aa46e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceb78c2-1891-43ce-b32d-7b17c6604cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume 8283f58d-04c3-4df5-ac3c-c937b1f2de19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19', 'volume_size': 1} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Flow 'volume_create_manager' (a5e1b416-fa3b-4093-96f4-a58a03131a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95344b93-1766-45a4-a665-bc46857b480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95344b93-1766-45a4-a665-bc46857b480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1328493428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910dce1a-de12-4424-aa97-64b03a4af46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638c03d79ee436f9cd2aaf2b33b79e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:48Z,use_quota=True,user_id='5160221a6a47490d9578d5f5d91a4b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba6f684-3b9d-4b48-bf6b-4f18aa9fcfc0),volume_type_id=cba6f684-3b9d-4b48-bf6b-4f18aa9fcfc0)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80698c61-9f9c-497c-b1b4-55cb9466d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80698c61-9f9c-497c-b1b4-55cb9466d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec2ad6-a09b-4276-88c3-1e392773a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec2ad6-a09b-4276-88c3-1e392773a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910dce1a-de12-4424-aa97-64b03a4af46e', 'volume_name': 'volume-910dce1a-de12-4424-aa97-64b03a4af46e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb11226-22a2-476f-96b3-ce6425692bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb11226-22a2-476f-96b3-ce6425692bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683fd1ad-6daf-4e4e-93e3-7c3004b5fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:47 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume 910dce1a-de12-4424-aa97-64b03a4af46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910dce1a-de12-4424-aa97-64b03a4af46e', 'volume_size': 1} Aug 24 10:05:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Flow 'volume_create_manager' (1ec4d067-8328-4278-9a6a-8256c2a4e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e6bce5-c300-4f2e-810f-0a4a007f97dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e6bce5-c300-4f2e-810f-0a4a007f97dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1494917480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e002814-0f62-4f73-a5d9-be9f21e86908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638c03d79ee436f9cd2aaf2b33b79e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:48Z,use_quota=True,user_id='5160221a6a47490d9578d5f5d91a4b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3da62d3-a972-4251-b8b0-f4d430881242),volume_type_id=a3da62d3-a972-4251-b8b0-f4d430881242)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6880f8b8-c8fb-4bf1-a601-bb529891fab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6880f8b8-c8fb-4bf1-a601-bb529891fab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfd81d6-87aa-4fb1-83fc-fef62d8b3069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfd81d6-87aa-4fb1-83fc-fef62d8b3069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e002814-0f62-4f73-a5d9-be9f21e86908', 'volume_name': 'volume-7e002814-0f62-4f73-a5d9-be9f21e86908', 'volume_size': 1, 'image_id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1391487437', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4638c03d79ee436f9cd2aaf2b33b79e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'created_at': datetime.datetime(2026, 8, 24, 8, 5, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 5, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3/file', 'properties': {}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8add48-a561-4465-84d0-da4f53827d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8add48-a561-4465-84d0-da4f53827d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15bb819-e4fe-4816-9b77-eb6d81f24b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:05:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume 7e002814-0f62-4f73-a5d9-be9f21e86908: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e002814-0f62-4f73-a5d9-be9f21e86908', 'volume_size': 1, 'image_id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1391487437', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4638c03d79ee436f9cd2aaf2b33b79e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'created_at': datetime.datetime(2026, 8, 24, 8, 5, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 5, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3/file', 'properties': {}}, 'image_service': } Aug 24 10:05:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Trying to clone 7e002814-0f62-4f73-a5d9-be9f21e86908 from image b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:05:52 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD, size 20.69 MB, duration 3.77 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:05:52 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Image download 20.69 MB at 5.48 MB/s Aug 24 10:05:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc8d60a-20bd-4cd7-b85e-1fedc8f53023]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:52 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD Aug 24 10:05:52 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:52 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:52 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Temporary image b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 is fetched for user 5160221a6a47490d9578d5f5d91a4b2e. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:05:53 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=123,cinder:INSERT=34,cinder:UPDATE=154,cinder:DELETE=15 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:05:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a33816-0bee-4e95-84e5-195971b54747]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:05:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:05:53 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD Aug 24 10:05:53 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:05:53 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Aug 24 10:05:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:05:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.630s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Uploaded volume to glance image-id: e7808280-8359-4692-896d-35798fa20ee4. {{(pid=94039) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.749s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1539019680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de63083b87c34b4189a3b55493fb9630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:44Z,use_quota=True,user_id='4f3b9ea68aea4e63a9df55536c24faa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Creating volume e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:03 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:03 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 1073741824 Aug 24 10:06:03 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-3502a889-27a7-4ba2-9e21-eabd871a3458 tempest-VolumesActionsTest-1692002097 None] Copy volume to image completed successfully. Aug 24 10:06:03 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 1073741824" returned: 0 in 0.410s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:03 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 Aug 24 10:06:03 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:04 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7" returned: 0 in 0.243s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.569s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793887335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c51493-7983-434d-968f-c8c6e8840d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:46Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Creating volume c4c51493-7983-434d-968f-c8c6e8840d3c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:04 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055e4df9-057d-49fc-8ce7-4e131f9b1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:04 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c 1073741824 Aug 24 10:06:04 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd4ad6d-f75b-4fba-aec4-0c05cb27a4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Volume volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 (e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7): created successfully Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd4ad6d-f75b-4fba-aec4-0c05cb27a4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Flow 'volume_create_manager' (6d25b547-f6ab-453f-b9d5-40731c157d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fbe214bb-0045-4755-a250-819eca755c4b tempest-VolumesNegativeTest-436979387 None] Created volume successfully. Aug 24 10:06:04 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c 1073741824" returned: 0 in 0.443s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:04 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c Aug 24 10:06:04 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:04 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.594s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1350461668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8283f58d-04c3-4df5-ac3c-c937b1f2de19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638c03d79ee436f9cd2aaf2b33b79e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:47Z,use_quota=True,user_id='5160221a6a47490d9578d5f5d91a4b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0b499dc-1f79-41d5-bab9-10a9273ffef3),volume_type_id=a0b499dc-1f79-41d5-bab9-10a9273ffef3)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Creating volume 8283f58d-04c3-4df5-ac3c-c937b1f2de19 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:04 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db91199f-2f8b-4873-9460-7bb0115c6067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c51493-7983-434d-968f-c8c6e8840d3c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e06f54-65b9-4531-bd70-8cb809758ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:04 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 1073741824 Aug 24 10:06:04 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Volume volume-c4c51493-7983-434d-968f-c8c6e8840d3c (c4c51493-7983-434d-968f-c8c6e8840d3c): created successfully Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e06f54-65b9-4531-bd70-8cb809758ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (a03d29f9-f04b-408d-aa9c-8cbc28959ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6e38fda3-7876-4e84-94d1-a9e390c2e63f tempest-ProjectReaderTests-1761248680 None] Created volume successfully. Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:05 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 1073741824" returned: 0 in 0.479s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:05 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 Aug 24 10:06:05 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:05 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.966s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1328493428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910dce1a-de12-4424-aa97-64b03a4af46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638c03d79ee436f9cd2aaf2b33b79e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:48Z,use_quota=True,user_id='5160221a6a47490d9578d5f5d91a4b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cba6f684-3b9d-4b48-bf6b-4f18aa9fcfc0),volume_type_id=cba6f684-3b9d-4b48-bf6b-4f18aa9fcfc0)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Creating volume 910dce1a-de12-4424-aa97-64b03a4af46e {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:05 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:05 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e 1073741824 Aug 24 10:06:05 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aceb78c2-1891-43ce-b32d-7b17c6604cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce112c9-46d2-4064-92e7-883e8aacf7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-c4c51493-7983-434d-968f-c8c6e8840d3c-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 (8283f58d-04c3-4df5-ac3c-c937b1f2de19): created successfully Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce112c9-46d2-4064-92e7-883e8aacf7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Flow 'volume_create_manager' (94aae8e5-4e7e-4c64-8e00-6c18945c7323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-c4c51493-7983-434d-968f-c8c6e8840d3c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ae487c63-4852-425b-8ee6-e88834d4f25b tempest-TestInstancesWithCinderVolumes-1968975792 None] Created volume successfully. Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-quobyte-c4c51493-7983-434d-968f-c8c6e8840d3c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-c4c51493-7983-434d-968f-c8c6e8840d3c" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f3ea6-7218-4568-8655-6d2e4a89dbd8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:06 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c Aug 24 10:06:06 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:06 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e 1073741824" returned: 0 in 0.536s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:06 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e Aug 24 10:06:06 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:06 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c" returned: 0 in 0.427s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:06 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c Aug 24 10:06:06 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:06 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e" returned: 0 in 0.291s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.291s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1494917480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e002814-0f62-4f73-a5d9-be9f21e86908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4638c03d79ee436f9cd2aaf2b33b79e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:05:48Z,use_quota=True,user_id='5160221a6a47490d9578d5f5d91a4b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3da62d3-a972-4251-b8b0-f4d430881242),volume_type_id=a3da62d3-a972-4251-b8b0-f4d430881242)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Creating volume 7e002814-0f62-4f73-a5d9-be9f21e86908 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:06 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 1073741824 Aug 24 10:06:06 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683fd1ad-6daf-4e4e-93e3-7c3004b5fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910dce1a-de12-4424-aa97-64b03a4af46e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:06 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d95c72-7ec4-4806-9b22-934d0c34f02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c4c51493-7983-434d-968f-c8c6e8840d3c" returned: 0 in 0.319s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-c4c51493-7983-434d-968f-c8c6e8840d3c" released by "delete_volume" :: held 0.795s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume volume-910dce1a-de12-4424-aa97-64b03a4af46e (910dce1a-de12-4424-aa97-64b03a4af46e): created successfully Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d95c72-7ec4-4806-9b22-934d0c34f02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Flow 'volume_create_manager' (a5e1b416-fa3b-4093-96f4-a58a03131a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-14b72ca6-b1ab-4420-8bff-a25f3d0e7a2f tempest-TestInstancesWithCinderVolumes-1968975792 None] Created volume successfully. Aug 24 10:06:06 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Created reservations ['b0c76ceb-d917-414d-a281-7c335868ba65', 'c3d3efe1-9daa-4ce5-93e1-a91385528e3d', '67635cc0-56e9-4452-baa1-d44dc94e4636', 'a10db18b-e503-4825-a4f2-331f32b08c21'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:07 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:07 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:07 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.299s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:07 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Deleted volume successfully. Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 1073741824" returned: 0 in 0.691s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f12d0a78-06d6-4e07-960b-974864e40e72 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-c4c51493-7983-434d-968f-c8c6e8840d3c-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:07 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 Aug 24 10:06:07 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:07 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (10122f54-0f82-46ae-94df-e5a3bc581475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5588bed-4e5a-4724-9bcc-fda45937cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908" returned: 0 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.622s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5588bed-4e5a-4724-9bcc-fda45937cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605266851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3320f7b2-c6ce-4cd7-9258-ee689a26896e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:08Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc138b4-e0fc-4562-8d70-cf2bd7ddf4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc138b4-e0fc-4562-8d70-cf2bd7ddf4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd834420-a3e8-43ca-b531-09c75dc0e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd834420-a3e8-43ca-b531-09c75dc0e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3320f7b2-c6ce-4cd7-9258-ee689a26896e', 'volume_name': 'volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8ac817-5adf-4e83-a5e8-b1b681627e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8ac817-5adf-4e83-a5e8-b1b681627e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98fc753-5eb0-40b2-96a8-cc9eb03e252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Volume 3320f7b2-c6ce-4cd7-9258-ee689a26896e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e', 'volume_size': 1} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[37845fe0-10a7-41ee-b3c0-6d891f30327a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Attempting download of b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'metadata': {}}])) to volume 7e002814-0f62-4f73-a5d9-be9f21e86908. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[142ee329-0db4-4825-a9d1-acdc7c414af9]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:08 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:06:08 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:08 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck Aug 24 10:06:08 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:08 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.541s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d53f52-2a0c-438f-9940-0a6ea75e8a00]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:08 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck" returned: 0 in 0.440s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:08 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:06:08 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:08 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck Aug 24 10:06:08 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:08 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck" returned: 1 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_r9k0bbck' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7142d2cd-c210-46a2-88d5-0c9912c2d73a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:08 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.521s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:08 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img Aug 24 10:06:08 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:08 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD Aug 24 10:06:08 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:09 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:09 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 was qcow2, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:06:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:09 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 Aug 24 10:06:09 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:14 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908" returned: 0 in 5.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:14 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3_qabw85_edevstack@QuobyteHD, size 112.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:06:14 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Converted 112.00 MB image at 20.64 MB/s Aug 24 10:06:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:14 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 1G Aug 24 10:06:14 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:15 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img" returned: 0 in 6.327s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d163b136-24d0-484e-a1ec-32477fbe890b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:15 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:06:15 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:15 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 1G" returned: 0 in 0.880s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Downloaded image b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'metadata': {}}])) to volume 7e002814-0f62-4f73-a5d9-be9f21e86908 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Temporary image b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 for user 5160221a6a47490d9578d5f5d91a4b2e is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Marking volume 7e002814-0f62-4f73-a5d9-be9f21e86908 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Copying metadata from image b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 to 7e002814-0f62-4f73-a5d9-be9f21e86908. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Creating volume glance metadata for volume 7e002814-0f62-4f73-a5d9-be9f21e86908 backed by image b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3 with: {'image_id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'image_name': 'tempest-scenario-img--1391487437', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15bb819-e4fe-4816-9b77-eb6d81f24b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e002814-0f62-4f73-a5d9-be9f21e86908', 'volume_size': 1, 'image_id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1391487437', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4638c03d79ee436f9cd2aaf2b33b79e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3', 'created_at': datetime.datetime(2026, 8, 24, 8, 5, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 5, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1b0ee12-c2b5-4b26-bbde-f42fc81bbac3/file', 'properties': {}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab914d92-d9bc-43d2-aa4a-0548ea78eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:15 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Volume volume-7e002814-0f62-4f73-a5d9-be9f21e86908 (7e002814-0f62-4f73-a5d9-be9f21e86908): created successfully Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab914d92-d9bc-43d2-aa4a-0548ea78eda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Flow 'volume_create_manager' (1ec4d067-8328-4278-9a6a-8256c2a4e576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2a9f209a-7624-47e7-bc6a-f9701e18ea62 tempest-TestInstancesWithCinderVolumes-1968975792 None] Created volume successfully. Aug 24 10:06:15 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.652s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:06:15 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Converted 1024.00 MB image at 161.80 MB/s Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] 0747d2ed-137c-411c-a604-05b8bb7b5d38 was raw, converting to qcow2 {{(pid=94039) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a83534-9e09-428c-908e-669153d057b5]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:16 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img Aug 24 10:06:16 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:16 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:16 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img Aug 24 10:06:16 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:16 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img" returned: 1 in 0.387s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:06:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img /opt/stack/data/cinder/conversion/vol_upload_hpngzamy {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:16 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img /opt/stack/data/cinder/conversion/vol_upload_hpngzamy Aug 24 10:06:16 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:17 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img /opt/stack/data/cinder/conversion/vol_upload_hpngzamy" returned: 0 in 0.472s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:17 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Image conversion details: src /opt/stack/data/cinder/conversion/b99f2d28-a245-4a3a-b45a-c86e5f9f0e22.temp_image.0747d2ed-137c-411c-a604-05b8bb7b5d38o9pbk1vu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hpngzamy {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:06:17 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 24 10:06:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b966aeb-4c69-4ab7-937a-233219d149e3]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hpngzamy {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:17 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hpngzamy Aug 24 10:06:17 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:17 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hpngzamy" returned: 0 in 0.472s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-74912d42-9cf5-4d63-935b-f852af95e230 req-09dbf76e-62d5-434b-a444-db2c7e0e5ff3 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.264s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Uploaded volume to glance image-id: 0747d2ed-137c-411c-a604-05b8bb7b5d38. {{(pid=94039) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.213s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605266851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3320f7b2-c6ce-4cd7-9258-ee689a26896e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:08Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Creating volume 3320f7b2-c6ce-4cd7-9258-ee689a26896e {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:20 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:20 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e 1073741824 Aug 24 10:06:20 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a2ff1b5f-8504-4e18-8365-d4153bf6f500 tempest-VolumesActionsTest-1692002097 None] Copy volume to image completed successfully. Aug 24 10:06:20 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e 1073741824" returned: 0 in 0.642s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:20 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e Aug 24 10:06:20 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:21 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-74912d42-9cf5-4d63-935b-f852af95e230 req-09dbf76e-62d5-434b-a444-db2c7e0e5ff3 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.094s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98fc753-5eb0-40b2-96a8-cc9eb03e252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f15fbe8-81a6-490c-ae12-3210826deb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-74912d42-9cf5-4d63-935b-f852af95e230 req-09dbf76e-62d5-434b-a444-db2c7e0e5ff3 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Volume volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e (3320f7b2-c6ce-4cd7-9258-ee689a26896e): created successfully Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f15fbe8-81a6-490c-ae12-3210826deb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (10122f54-0f82-46ae-94df-e5a3bc581475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b47b108a-7927-404a-b272-36686f529b22 tempest-ProjectReaderTests-1761248680 None] Created volume successfully. Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-74912d42-9cf5-4d63-935b-f852af95e230 req-09dbf76e-62d5-434b-a444-db2c7e0e5ff3 tempest-TestInstancesWithCinderVolumes-1968975792 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-7e002814-0f62-4f73-a5d9-be9f21e86908', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9efead35-beb0-481a-b1a7-54f6f1a8ad99', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:06:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-74912d42-9cf5-4d63-935b-f852af95e230 req-09dbf76e-62d5-434b-a444-db2c7e0e5ff3 tempest-TestInstancesWithCinderVolumes-1968975792 None] attachment_update completed successfully. Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "cinder-quobyte-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-quobyte-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" acquired by "delete_volume" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[44925f45-8035-4699-bcca-06bb4f3372eb]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-3320f7b2-c6ce-4cd7-9258-ee689a26896e-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-3320f7b2-c6ce-4cd7-9258-ee689a26896e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-quobyte-3320f7b2-c6ce-4cd7-9258-ee689a26896e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-3320f7b2-c6ce-4cd7-9258-ee689a26896e" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:21 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:06:21 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f483f668-93de-40da-b6d0-baa0c921a5c1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:21 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e Aug 24 10:06:21 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:22 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.577s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:22 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22 Aug 24 10:06:22 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:22 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e" returned: 0 in 0.489s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:22 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e Aug 24 10:06:22 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:22 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-quobyte-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22" released by "delete_volume" :: held 1.073s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:22 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3320f7b2-c6ce-4cd7-9258-ee689a26896e" returned: 0 in 0.358s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-3320f7b2-c6ce-4cd7-9258-ee689a26896e" released by "delete_volume" :: held 0.924s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Created reservations ['d82676df-724a-4127-bd48-823e95297e7a', '6d7dec81-ded3-47f6-866a-882063523dcf', 'e0c90d84-6171-4ee4-9200-81218c1f3a4d', 'af1b5208-3681-439f-88e7-dbab5b319770'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:22 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Created reservations ['f7d3c3a2-abb6-499d-8905-8e92ec8101e4', '6ce0a623-3b9d-41a2-b0f2-69a2c5df6e98', '55a91a13-03ed-4dec-8c03-2a1772c8c038', 'dbb14e6a-2811-459e-bde6-46e53c5b856c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:22 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:22 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:23 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:23 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:23 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.403s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Deleted volume successfully. Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0e563992-02f3-4ac0-bcee-423e789f3795 tempest-VolumesActionsTest-1692002097 None] Lock "cinder-b99f2d28-a245-4a3a-b45a-c86e5f9f0e22-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:23 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Deleted volume successfully. Aug 24 10:06:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-83b63d3a-3bc5-462d-a74b-91e68a879162 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-3320f7b2-c6ce-4cd7-9258-ee689a26896e-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (1d4c5caf-f051-4bf0-8ef5-3f0d8dad9012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810e3fae-4096-4399-9ea3-14ce96af724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810e3fae-4096-4399-9ea3-14ce96af724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665338007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a72cf5-b571-492f-8c5d-16e7064660b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:25Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544af595-179c-4f6e-a741-a38cbdb42b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544af595-179c-4f6e-a741-a38cbdb42b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f8cee-3b27-40bc-ab87-a5be0fa913e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f8cee-3b27-40bc-ab87-a5be0fa913e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a72cf5-b571-492f-8c5d-16e7064660b3', 'volume_name': 'volume-89a72cf5-b571-492f-8c5d-16e7064660b3', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c3f958-3d5c-44fc-9231-c92ad464ff68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c3f958-3d5c-44fc-9231-c92ad464ff68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4135b58-a58e-489f-adad-c84fe1a5101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Volume 89a72cf5-b571-492f-8c5d-16e7064660b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a72cf5-b571-492f-8c5d-16e7064660b3', 'volume_size': 1} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665338007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a72cf5-b571-492f-8c5d-16e7064660b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:25Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Creating volume 89a72cf5-b571-492f-8c5d-16e7064660b3 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:25 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:25 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 1073741824 Aug 24 10:06:25 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:25 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 1073741824" returned: 0 in 0.739s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:26 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 Aug 24 10:06:26 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:26 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:26 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:26 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3" returned: 0 in 0.311s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4135b58-a58e-489f-adad-c84fe1a5101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a72cf5-b571-492f-8c5d-16e7064660b3', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83adf8d4-7e28-4edc-bd6e-4e4223d6c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:26 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Volume volume-89a72cf5-b571-492f-8c5d-16e7064660b3 (89a72cf5-b571-492f-8c5d-16e7064660b3): created successfully Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83adf8d4-7e28-4edc-bd6e-4e4223d6c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (1d4c5caf-f051-4bf0-8ef5-3f0d8dad9012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-182717fe-49ac-401d-af2d-71954dd6898f tempest-ProjectReaderTests-1761248680 None] Created volume successfully. Aug 24 10:06:26 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:06:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:06:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-89a72cf5-b571-492f-8c5d-16e7064660b3-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-89a72cf5-b571-492f-8c5d-16e7064660b3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-quobyte-89a72cf5-b571-492f-8c5d-16e7064660b3" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-89a72cf5-b571-492f-8c5d-16e7064660b3" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[686accb6-d0e8-47cf-b238-4ae8f771f47d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:27 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 Aug 24 10:06:27 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:28 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3" returned: 0 in 0.519s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:28 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3 Aug 24 10:06:28 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:28 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-89a72cf5-b571-492f-8c5d-16e7064660b3" returned: 0 in 0.463s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-89a72cf5-b571-492f-8c5d-16e7064660b3" released by "delete_volume" :: held 1.041s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Created reservations ['dd581dea-5c6f-4167-8b96-7c1f978e1bd0', 'efb8be49-9b77-4c01-8352-360a9d0e3d75', '1eff78d3-ee87-4b15-b241-86c76e049217', 'e274b1d1-dc07-4172-8fb9-b8fb5446f492'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:28 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:28 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:29 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.342s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Deleted volume successfully. Aug 24 10:06:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ae31de7d-e369-4b05-805b-1af8d31209c8 tempest-ProjectReaderTests-1761248680 None] Lock "cinder-89a72cf5-b571-492f-8c5d-16e7064660b3-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (103d55c1-c379-4e19-bd12-8b6bd900b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b0d6f3-4a68-4d66-9de2-2b155add5830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b0d6f3-4a68-4d66-9de2-2b155add5830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563851259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d67d5d-b8f7-40d8-ac04-67e013d5b61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:31Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae52e93-33e4-48da-b3ab-423643b462bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae52e93-33e4-48da-b3ab-423643b462bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2beda5-c005-4f2d-88f3-7904bf521ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2beda5-c005-4f2d-88f3-7904bf521ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d67d5d-b8f7-40d8-ac04-67e013d5b61a', 'volume_name': 'volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3005813-62a8-4119-b576-5fdd58c50b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3005813-62a8-4119-b576-5fdd58c50b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f977eaae-9804-410d-bd08-9c8e5cc88e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:30 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Volume c9d67d5d-b8f7-40d8-ac04-67e013d5b61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a', 'volume_size': 1} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1563851259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d67d5d-b8f7-40d8-ac04-67e013d5b61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87e27dd384f48638bc84b5b5dd1f47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:31Z,use_quota=True,user_id='bf28d57c5de94ad1bb30e8142c278f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Creating volume c9d67d5d-b8f7-40d8-ac04-67e013d5b61a {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:30 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:30 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a 1073741824 Aug 24 10:06:30 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:32 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a 1073741824" returned: 0 in 1.331s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:32 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a Aug 24 10:06:32 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:32 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a" returned: 0 in 0.620s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f977eaae-9804-410d-bd08-9c8e5cc88e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:32 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb0f37c-0573-4813-8e7e-11cf60fa7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:33 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Volume volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a (c9d67d5d-b8f7-40d8-ac04-67e013d5b61a): created successfully Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb0f37c-0573-4813-8e7e-11cf60fa7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Flow 'volume_create_manager' (103d55c1-c379-4e19-bd12-8b6bd900b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2079d62e-ddc0-4b91-a96e-47b599a38f27 tempest-ProjectReaderTests-1761248680 None] Created volume successfully. Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Acquiring lock "cinder-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Lock "cinder-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Acquiring lock "cinder-quobyte-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Lock "cinder-quobyte-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d4887-1b84-487e-9a55-e80047fdbd1b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:33 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 Aug 24 10:06:33 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Lock "cinder-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:34 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7" returned: 0 in 0.803s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Acquiring lock "cinder-quobyte-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:34 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7 Aug 24 10:06:34 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e1f9e3-36f8-42d1-9885-8d42d2058ba0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:34 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a Aug 24 10:06:34 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:34 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7" returned: 0 in 0.535s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Lock "cinder-quobyte-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7" released by "delete_volume" :: held 1.421s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Created reservations ['4c31156b-1e37-429f-8d9d-ca5e54243bb0', '6acbe8f7-850f-48b7-895c-83fc84f2557d', '6335f371-b69e-45c9-bc35-91785cc24a97', 'b3f0fa94-c423-4b63-bd43-cc8016dd2ac3'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:35 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a" returned: 0 in 0.778s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:35 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a Aug 24 10:06:35 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:35 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:35 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:36 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a" returned: 0 in 0.838s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Lock "cinder-quobyte-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a" released by "delete_volume" :: held 1.714s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:36 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Created reservations ['c6c147f4-ff1d-49e4-9f5e-09345c9e5e60', 'f9eea023-27a8-4a10-b787-0445b16a959f', '1372bae4-aef6-41a4-a2aa-89340c61222c', '9da47fb1-601a-4ccc-8164-02d4c584d549'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.983s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:36 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Deleted volume successfully. Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1f9b410-5388-4737-9674-1a9d2e3e07cc tempest-VolumesNegativeTest-436979387 None] Lock "cinder-e325fd97-ef87-4a3f-bbc4-9df9bd32bfb7-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:36 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:36 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:37 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.859s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:37 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Deleted volume successfully. Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d9559884-2382-431e-8b8c-e218bb4bf2af tempest-ProjectReaderTests-1761248680 None] Lock "cinder-c9d67d5d-b8f7-40d8-ac04-67e013d5b61a-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Flow 'volume_create_manager' (0e4fc447-a161-4b23-b18c-8d2cb9926ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140967bc-2a2a-4329-b739-4567d08178d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140967bc-2a2a-4329-b739-4567d08178d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1756923378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4b3396-dec2-4959-b65f-ba941c12a541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86648486de4478cb9dca6b8f752c090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:37Z,use_quota=True,user_id='9a94ce732d2c462f879d8dd9bf94302f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64924cf9-5985-4b8a-b74f-2c9905e6b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64924cf9-5985-4b8a-b74f-2c9905e6b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da473954-98eb-4cd6-ad0c-6a3885be5536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da473954-98eb-4cd6-ad0c-6a3885be5536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4b3396-dec2-4959-b65f-ba941c12a541', 'volume_name': 'volume-0d4b3396-dec2-4959-b65f-ba941c12a541', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea79df0-e79c-4503-91cd-75d3dafe0c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea79df0-e79c-4503-91cd-75d3dafe0c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30048aa6-16cb-46a6-ac31-b0c24824118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:37 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Volume 0d4b3396-dec2-4959-b65f-ba941c12a541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4b3396-dec2-4959-b65f-ba941c12a541', 'volume_size': 1} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1756923378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4b3396-dec2-4959-b65f-ba941c12a541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86648486de4478cb9dca6b8f752c090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:37Z,use_quota=True,user_id='9a94ce732d2c462f879d8dd9bf94302f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Creating volume 0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:37 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:37 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 1073741824 Aug 24 10:06:37 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:38 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 1073741824" returned: 0 in 1.048s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:38 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 Aug 24 10:06:38 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:39 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30048aa6-16cb-46a6-ac31-b0c24824118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4b3396-dec2-4959-b65f-ba941c12a541', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388301e9-0f45-4ee8-bc38-31a83996d8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:39 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Volume volume-0d4b3396-dec2-4959-b65f-ba941c12a541 (0d4b3396-dec2-4959-b65f-ba941c12a541): created successfully Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388301e9-0f45-4ee8-bc38-31a83996d8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:39 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Flow 'volume_create_manager' (0e4fc447-a161-4b23-b18c-8d2cb9926ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:39 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9cbe175e-72fa-499a-924a-c6a6416f6b9c tempest-VolumesCloneTest-1826973083 None] Created volume successfully. Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Flow 'volume_create_manager' (31abe446-c0f7-466f-bf3d-122261dbd915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730352d9-73d5-4c15-9cd0-1cd916c20150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730352d9-73d5-4c15-9cd0-1cd916c20150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1389929453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ce85f-c8de-4db5-b277-c49ae846c2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e86648486de4478cb9dca6b8f752c090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=0d4b3396-dec2-4959-b65f-ba941c12a541,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:41Z,use_quota=True,user_id='9a94ce732d2c462f879d8dd9bf94302f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3781d5-0172-4c4a-aaaa-8a46caabd633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3781d5-0172-4c4a-aaaa-8a46caabd633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6a2ba4-ba0c-4f89-9d9d-6f189102c178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6a2ba4-ba0c-4f89-9d9d-6f189102c178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a4ce85f-c8de-4db5-b277-c49ae846c2ee', 'volume_name': 'volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee', 'volume_size': 2, 'source_volid': '0d4b3396-dec2-4959-b65f-ba941c12a541', 'source_volstatus': 'available'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13cba9f-549e-4628-8df9-3503ee396187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13cba9f-549e-4628-8df9-3503ee396187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ff7b78-e576-426b-bf74-bdafed3117d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:40 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Volume 3a4ce85f-c8de-4db5-b277-c49ae846c2ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee', 'volume_size': 2, 'source_volid': '0d4b3396-dec2-4959-b65f-ba941c12a541', 'source_volstatus': 'available'} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:41 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Cloning volume 0d4b3396-dec2-4959-b65f-ba941c12a541 to volume 3a4ce85f-c8de-4db5-b277-c49ae846c2ee Aug 24 10:06:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Creating offline snapshot 27768e39-f1f3-4cc9-8c82-19bd09364486 of volume 0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:06:41 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b9bc5-c42b-4e3f-a173-73071e4f1f1f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:41 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 Aug 24 10:06:41 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:41 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541" returned: 0 in 0.440s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:41 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 1G Aug 24 10:06:41 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:42 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 1G" returned: 0 in 0.609s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4b3396-dec2-4959-b65f-ba941c12a541 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:42 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4b3396-dec2-4959-b65f-ba941c12a541 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 Aug 24 10:06:42 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Flow 'volume_create_manager' (ca9696cf-cdd3-43d4-8414-687e618ae131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e37f23-405b-43f8-b965-d0495b4898ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e37f23-405b-43f8-b965-d0495b4898ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-822832266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051253d3-21f6-4489-864b-c350defdc13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff6d65845914ca88206f57a7bcfe33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:42Z,use_quota=True,user_id='a7ef95283e3946818bea4139de4f18b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bbe72a-1b7d-4027-8949-843f19421ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0bbe72a-1b7d-4027-8949-843f19421ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ffd76c-ad5e-4f66-aceb-b633a5dc3442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ffd76c-ad5e-4f66-aceb-b633a5dc3442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051253d3-21f6-4489-864b-c350defdc13c', 'volume_name': 'volume-051253d3-21f6-4489-864b-c350defdc13c', 'volume_size': 2}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c07411b-49fd-4e6f-85af-f72f753b31ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c07411b-49fd-4e6f-85af-f72f753b31ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786f6dbb-4bd1-4b9e-86fa-84c22a91a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:42 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Volume 051253d3-21f6-4489-864b-c350defdc13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051253d3-21f6-4489-864b-c350defdc13c', 'volume_size': 2} Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:42 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4b3396-dec2-4959-b65f-ba941c12a541 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486" returned: 0 in 0.616s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:42 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 is being set with open permissions: ugo+rw Aug 24 10:06:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:42 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 Aug 24 10:06:42 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:43 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486" returned: 0 in 0.364s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:43 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info Aug 24 10:06:43 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:43 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:43 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info is being set with open permissions: ugo+rw Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:43 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info Aug 24 10:06:43 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:43 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.info" returned: 0 in 0.245s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Acquiring lock "cinder-quobyte-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] snapshot: 27768e39-f1f3-4cc9-8c82-19bd09364486, volume: 3a4ce85f-c8de-4db5-b277-c49ae846c2ee, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1310e6d-c7fe-4dcd-a95e-e240bfefab74]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:43 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 Aug 24 10:06:43 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:44 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486" returned: 0 in 0.401s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d4b3396-dec2-4959-b65f-ba941c12a541(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24d5916-8f73-48f3-a086-b6ad4586027b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:44 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 Aug 24 10:06:44 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:44 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:06:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:44 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee Aug 24 10:06:44 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:48 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" returned: 0 in 4.270s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:48 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:06:48 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Converted 1024.00 MB image at 239.70 MB/s Aug 24 10:06:48 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee is being set with open permissions: ugo+rw Aug 24 10:06:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:48 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee Aug 24 10:06:48 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:49 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" returned: 0 in 0.236s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" released by "_copy_volume_from_snapshot" :: held 5.423s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Acquiring lock "cinder-quobyte-27768e39-f1f3-4cc9-8c82-19bd09364486" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-27768e39-f1f3-4cc9-8c82-19bd09364486" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Deleting offline snapshot 27768e39-f1f3-4cc9-8c82-19bd09364486 of volume 0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] snapshot_file for this snap is: volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a5fd9e-9d5b-498a-99f0-0aca8989dedb]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:49 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 Aug 24 10:06:49 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:49 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486" returned: 0 in 0.355s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d4b3396-dec2-4959-b65f-ba941c12a541(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f4afc0-e9b8-4af7-8ced-1a845093515e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:49 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 Aug 24 10:06:49 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:50 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541" returned: 0 in 0.512s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:50 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 Aug 24 10:06:50 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:50 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486" returned: 0 in 0.315s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:50 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486 Aug 24 10:06:50 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:50 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541.27768e39-f1f3-4cc9-8c82-19bd09364486" returned: 0 in 0.240s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-27768e39-f1f3-4cc9-8c82-19bd09364486" released by "_delete_snapshot" :: held 1.508s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.725s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.093s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-822832266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051253d3-21f6-4489-864b-c350defdc13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff6d65845914ca88206f57a7bcfe33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:42Z,use_quota=True,user_id='a7ef95283e3946818bea4139de4f18b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Creating volume 051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:50 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c 2147483648 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:50 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c 2147483648 Aug 24 10:06:50 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ff7b78-e576-426b-bf74-bdafed3117d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee', 'volume_size': 2, 'source_volid': '0d4b3396-dec2-4959-b65f-ba941c12a541', 'source_volstatus': 'available'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b53c37d-ed25-4172-9fb8-8fcc20e8fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:50 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Volume volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee (3a4ce85f-c8de-4db5-b277-c49ae846c2ee): created successfully Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b53c37d-ed25-4172-9fb8-8fcc20e8fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Flow 'volume_create_manager' (31abe446-c0f7-466f-bf3d-122261dbd915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4fa50430-42ad-4501-bffb-abb27badf41c tempest-VolumesCloneTest-1826973083 None] Created volume successfully. Aug 24 10:06:51 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c 2147483648" returned: 0 in 0.452s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:51 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c Aug 24 10:06:51 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:51 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c" returned: 0 in 0.244s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786f6dbb-4bd1-4b9e-86fa-84c22a91a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051253d3-21f6-4489-864b-c350defdc13c', 'volume_size': 2}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9954f4ab-6981-41e8-bcaf-7799f7044ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:51 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Volume volume-051253d3-21f6-4489-864b-c350defdc13c (051253d3-21f6-4489-864b-c350defdc13c): created successfully Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9954f4ab-6981-41e8-bcaf-7799f7044ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Flow 'volume_create_manager' (ca9696cf-cdd3-43d4-8414-687e618ae131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-050ee12a-3b1d-4ef3-a1ac-05501ad09872 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Created volume successfully. Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Acquiring lock "cinder-3a4ce85f-c8de-4db5-b277-c49ae846c2ee-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Lock "cinder-3a4ce85f-c8de-4db5-b277-c49ae846c2ee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Acquiring lock "cinder-quobyte-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8f17ae-d554-48c9-89e9-2dc0bd3fb4f1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:51 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee Aug 24 10:06:51 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:51 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" returned: 0 in 0.334s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:51 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee Aug 24 10:06:51 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:52 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" returned: 0 in 0.242s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-3a4ce85f-c8de-4db5-b277-c49ae846c2ee" released by "delete_volume" :: held 0.614s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Created reservations ['0efcdd39-72c1-4274-a844-ef189237d900', '19e37b3a-87b9-42e2-b22c-5010f8907cec', '6f5d3da8-c9fa-45be-96ea-5bda895aae09', 'bb82582c-8575-418a-8130-b65d20380dc1'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:52 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:52 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Creating offline snapshot cbd80105-657a-41ad-8adb-106db1ac6a6e of volume 051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[01854121-525a-437c-a415-f3dc52736219]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:52 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c Aug 24 10:06:52 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:52 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.238s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:52 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Deleted volume successfully. Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d7cce201-2ded-436a-b928-82aab91f47aa tempest-VolumesCloneTest-1826973083 None] Lock "cinder-3a4ce85f-c8de-4db5-b277-c49ae846c2ee-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Acquiring lock "cinder-0d4b3396-dec2-4959-b65f-ba941c12a541-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Lock "cinder-0d4b3396-dec2-4959-b65f-ba941c12a541-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:52 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c" returned: 0 in 0.411s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e 2G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:52 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e 2G Aug 24 10:06:52 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Acquiring lock "cinder-quobyte-0d4b3396-dec2-4959-b65f-ba941c12a541" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-0d4b3396-dec2-4959-b65f-ba941c12a541" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab249c8-bbb2-4a1f-bd18-04594803278d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:53 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 Aug 24 10:06:53 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:53 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e 2G" returned: 0 in 0.478s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051253d3-21f6-4489-864b-c350defdc13c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:53 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051253d3-21f6-4489-864b-c350defdc13c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e Aug 24 10:06:53 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:53 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541" returned: 0 in 0.400s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:53 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541 Aug 24 10:06:53 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:53 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:53 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0d4b3396-dec2-4959-b65f-ba941c12a541" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051253d3-21f6-4489-864b-c350defdc13c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e" returned: 0 in 0.353s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:53 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e is being set with open permissions: ugo+rw Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Lock "cinder-quobyte-0d4b3396-dec2-4959-b65f-ba941c12a541" released by "delete_volume" :: held 0.779s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:53 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e Aug 24 10:06:53 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Created reservations ['ea5a6f05-4bef-40b4-bdd5-6ce84a83c016', 'dcdc73c3-8138-489b-a62d-d8ca0c1d6d35', '60d2b26d-3ba9-4b73-9bcb-82d0f7ca9905', 'd992dc31-366d-4c76-a5d0-cd1737d64d2b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:53 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:53 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:53 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e" returned: 0 in 0.281s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:54 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info Aug 24 10:06:54 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:54 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Deleted volume successfully. Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6f155943-30f5-4753-b587-8705011c1f34 tempest-VolumesCloneTest-1826973083 None] Lock "cinder-0d4b3396-dec2-4959-b65f-ba941c12a541-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:54 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:54 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info is being set with open permissions: ugo+rw Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:54 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info Aug 24 10:06:54 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:54 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.info" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4ec0a52d-4f80-47c8-b37b-341cadc55361 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Create snapshot completed successfully Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "cinder-cbd80105-657a-41ad-8adb-106db1ac6a6e-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-cbd80105-657a-41ad-8adb-106db1ac6a6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "cinder-quobyte-051253d3-21f6-4489-864b-c350defdc13c" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-quobyte-051253d3-21f6-4489-864b-c350defdc13c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "cinder-quobyte-cbd80105-657a-41ad-8adb-106db1ac6a6e" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-quobyte-cbd80105-657a-41ad-8adb-106db1ac6a6e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Deleting offline snapshot cbd80105-657a-41ad-8adb-106db1ac6a6e of volume 051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] snapshot_file for this snap is: volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f107e5-81a1-4c58-8946-c028976d4034]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:55 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e Aug 24 10:06:55 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:56 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e" returned: 0 in 0.378s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051253d3-21f6-4489-864b-c350defdc13c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c976361b-ab8b-4b2d-be18-eebb1bb06332]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:56 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c Aug 24 10:06:56 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:56 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:56 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e Aug 24 10:06:56 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:56 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e" returned: 0 in 0.401s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:56 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e Aug 24 10:06:56 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Flow 'volume_create_manager' (1f71dd56-d3d6-42a0-9b51-ca3ae1bda4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5542757c-f4b4-48af-a793-f4d1fe0c22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5542757c-f4b4-48af-a793-f4d1fe0c22f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696066997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375acf4f-bfbf-4d95-99c3-85e7a3760d75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a15228cc6d7545fdba28c06b0a3bcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:57Z,use_quota=True,user_id='fa61153c28b14eb2b17628b5929b1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b001a5c-a634-4c31-ae7b-58a6c315e5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:56 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b001a5c-a634-4c31-ae7b-58a6c315e5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb6b580-2add-40ff-a072-612414e2e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb6b580-2add-40ff-a072-612414e2e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375acf4f-bfbf-4d95-99c3-85e7a3760d75', 'volume_name': 'volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4c87e6-880d-402c-ab4b-a6348a25afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4c87e6-880d-402c-ab4b-a6348a25afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9a0235-da6b-4cbc-ad0f-669524c0f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Volume 375acf4f-bfbf-4d95-99c3-85e7a3760d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75', 'volume_size': 1} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696066997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375acf4f-bfbf-4d95-99c3-85e7a3760d75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a15228cc6d7545fdba28c06b0a3bcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:06:57Z,use_quota=True,user_id='fa61153c28b14eb2b17628b5929b1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Creating volume 375acf4f-bfbf-4d95-99c3-85e7a3760d75 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:57 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:57 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 1073741824 Aug 24 10:06:57 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:57 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c.cbd80105-657a-41ad-8adb-106db1ac6a6e" returned: 0 in 0.258s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-quobyte-cbd80105-657a-41ad-8adb-106db1ac6a6e" released by "_delete_snapshot" :: held 1.528s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-quobyte-051253d3-21f6-4489-864b-c350defdc13c" released by "delete_snapshot" :: held 1.555s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Created reservations ['37bb3485-ffdf-4911-ae0e-9e2841af0b69', '6be786e1-ba1c-40bf-a8e9-b3a167bf5339', 'fbd3f07e-8149-4060-b831-dbbf90b18518', '1ad99a39-72cb-484d-b476-cc1d3dcd7820'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Delete snapshot completed successfully. Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16dee22d-c2ad-4557-9d03-cce26add147c tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-cbd80105-657a-41ad-8adb-106db1ac6a6e-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:57 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 1073741824" returned: 0 in 0.459s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:57 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 Aug 24 10:06:57 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:57 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75" returned: 0 in 0.268s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9a0235-da6b-4cbc-ad0f-669524c0f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afc317b-3f44-435f-bf73-644eb400c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Volume volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 (375acf4f-bfbf-4d95-99c3-85e7a3760d75): created successfully Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afc317b-3f44-435f-bf73-644eb400c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Flow 'volume_create_manager' (1f71dd56-d3d6-42a0-9b51-ca3ae1bda4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a43f1dd2-b6c6-4e6e-bc4a-c712e1f88262 tempest-VolumesListTestJSON-1769688904 None] Created volume successfully. Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "cinder-051253d3-21f6-4489-864b-c350defdc13c-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-051253d3-21f6-4489-864b-c350defdc13c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-c50cdd47-7cb1-4c76-b27c-8a00d691e9a9 req-17017a21-0993-4a27-887a-6fcf80cd991f tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-c50cdd47-7cb1-4c76-b27c-8a00d691e9a9 req-17017a21-0993-4a27-887a-6fcf80cd991f tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-c50cdd47-7cb1-4c76-b27c-8a00d691e9a9 req-17017a21-0993-4a27-887a-6fcf80cd991f tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "cinder-quobyte-051253d3-21f6-4489-864b-c350defdc13c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:06:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-quobyte-051253d3-21f6-4489-864b-c350defdc13c" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648f7ea-2952-43c9-b0c2-acb0092c383b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-c50cdd47-7cb1-4c76-b27c-8a00d691e9a9 req-17017a21-0993-4a27-887a-6fcf80cd991f tempest-TestInstancesWithCinderVolumes-1968975792 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e9d9591-df86-49dd-ae18-166bdbfdc3b4', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:06:58 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-c50cdd47-7cb1-4c76-b27c-8a00d691e9a9 req-17017a21-0993-4a27-887a-6fcf80cd991f tempest-TestInstancesWithCinderVolumes-1968975792 None] attachment_update completed successfully. Aug 24 10:06:58 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c Aug 24 10:06:58 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:58 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c" returned: 0 in 0.356s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:58 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c Aug 24 10:06:58 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:58 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-051253d3-21f6-4489-864b-c350defdc13c" returned: 0 in 0.279s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-quobyte-051253d3-21f6-4489-864b-c350defdc13c" released by "delete_volume" :: held 0.700s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Created reservations ['e013bf24-91ab-4dbe-a548-bd54a244602b', '85448bcd-8f01-4962-ab1a-b88fd03346aa', 'd2b5cb8e-101c-4fe4-88f7-4c32f5d0fa5d', '888b351e-88f5-47fb-88f4-42f601fe8bb4'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:58 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:06:58 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:06:59 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.266s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:06:59 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Deleted volume successfully. Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0f65a4f2-60b8-4003-bc41-4e0ad33678b7 tempest-VolumesSnapshotNegativeTestJSON-622446206 None] Lock "cinder-051253d3-21f6-4489-864b-c350defdc13c-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Flow 'volume_create_manager' (ff560cec-060d-4142-bfec-6af794d99d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e8c963-323c-4d04-af21-a84664c17a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e8c963-323c-4d04-af21-a84664c17a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2143653306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c24abc-3ed6-482d-a087-a53a653c9db2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a15228cc6d7545fdba28c06b0a3bcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:00Z,use_quota=True,user_id='fa61153c28b14eb2b17628b5929b1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068d6bb9-e212-4533-8de8-6462eec01c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068d6bb9-e212-4533-8de8-6462eec01c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e767d0-564e-4691-a736-afa11be002f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e767d0-564e-4691-a736-afa11be002f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c24abc-3ed6-482d-a087-a53a653c9db2', 'volume_name': 'volume-24c24abc-3ed6-482d-a087-a53a653c9db2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7543dcda-e281-42ce-a6cc-5f5cc370b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7543dcda-e281-42ce-a6cc-5f5cc370b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b3c8a5-18a3-4281-92fe-0ee1120c486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:06:59 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Volume 24c24abc-3ed6-482d-a087-a53a653c9db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c24abc-3ed6-482d-a087-a53a653c9db2', 'volume_size': 1} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2143653306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c24abc-3ed6-482d-a087-a53a653c9db2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a15228cc6d7545fdba28c06b0a3bcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:00Z,use_quota=True,user_id='fa61153c28b14eb2b17628b5929b1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Creating volume 24c24abc-3ed6-482d-a087-a53a653c9db2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:06:59 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:06:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:06:59 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 1073741824 Aug 24 10:06:59 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:00 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 1073741824" returned: 0 in 0.489s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:00 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 Aug 24 10:07:00 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:00 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2" returned: 0 in 0.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b3c8a5-18a3-4281-92fe-0ee1120c486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c24abc-3ed6-482d-a087-a53a653c9db2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a08a574-0162-47c8-a1ad-1b08264cb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:00 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Volume volume-24c24abc-3ed6-482d-a087-a53a653c9db2 (24c24abc-3ed6-482d-a087-a53a653c9db2): created successfully Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a08a574-0162-47c8-a1ad-1b08264cb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Flow 'volume_create_manager' (ff560cec-060d-4142-bfec-6af794d99d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-dd5f8653-8280-4ca1-87e6-533884ebde62 tempest-VolumesListTestJSON-1769688904 None] Created volume successfully. Aug 24 10:07:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-cef5490a-4e3d-425b-9b06-a5f3d6ed6042 req-f9159ce8-9a7f-44cc-bb8f-925d76fa6cad tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-cef5490a-4e3d-425b-9b06-a5f3d6ed6042 req-f9159ce8-9a7f-44cc-bb8f-925d76fa6cad tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-cef5490a-4e3d-425b-9b06-a5f3d6ed6042 req-f9159ce8-9a7f-44cc-bb8f-925d76fa6cad tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-cef5490a-4e3d-425b-9b06-a5f3d6ed6042 req-f9159ce8-9a7f-44cc-bb8f-925d76fa6cad tempest-TestInstancesWithCinderVolumes-1968975792 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-910dce1a-de12-4424-aa97-64b03a4af46e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26167747-de3a-4f50-b1fa-69641f0a9eb4', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:07:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-cef5490a-4e3d-425b-9b06-a5f3d6ed6042 req-f9159ce8-9a7f-44cc-bb8f-925d76fa6cad tempest-TestInstancesWithCinderVolumes-1968975792 None] attachment_update completed successfully. Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Flow 'volume_create_manager' (46e8bca7-bd47-4866-a8f8-2b60d5b2fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e8ea25-7c37-4ab5-a98c-8c619a042e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e8ea25-7c37-4ab5-a98c-8c619a042e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-746500757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a6c0f7-ae7b-445e-94f5-dccb58815b41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a15228cc6d7545fdba28c06b0a3bcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:02Z,use_quota=True,user_id='fa61153c28b14eb2b17628b5929b1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26594d92-82ee-487d-ad4d-d35040781792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26594d92-82ee-487d-ad4d-d35040781792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dda77b-9414-4a9c-9d78-6d6db135b0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65dda77b-9414-4a9c-9d78-6d6db135b0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a6c0f7-ae7b-445e-94f5-dccb58815b41', 'volume_name': 'volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855c8bde-5b32-49eb-b300-68d0ad0bba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855c8bde-5b32-49eb-b300-68d0ad0bba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a7637c-a29d-4454-9503-0fbbebcb7c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Volume 15a6c0f7-ae7b-445e-94f5-dccb58815b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41', 'volume_size': 1} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-746500757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a6c0f7-ae7b-445e-94f5-dccb58815b41,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a15228cc6d7545fdba28c06b0a3bcecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:02Z,use_quota=True,user_id='fa61153c28b14eb2b17628b5929b1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Creating volume 15a6c0f7-ae7b-445e-94f5-dccb58815b41 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:07:02 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:07:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:02 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 1073741824 Aug 24 10:07:02 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:03 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 1073741824" returned: 0 in 0.572s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=106,cinder:UPDATE=127,cinder:DELETE=12,cinder:INSERT=31 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=123,cinder:INSERT=33,cinder:DELETE=11,cinder:SELECT=107 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:03 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 Aug 24 10:07:03 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:03 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41" returned: 0 in 0.277s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a7637c-a29d-4454-9503-0fbbebcb7c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c315564-a778-4d66-b10e-f02292587143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Volume volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 (15a6c0f7-ae7b-445e-94f5-dccb58815b41): created successfully Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c315564-a778-4d66-b10e-f02292587143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Flow 'volume_create_manager' (46e8bca7-bd47-4866-a8f8-2b60d5b2fa64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-13a76448-b02b-46ce-b588-c6e87b468abd tempest-VolumesListTestJSON-1769688904 None] Created volume successfully. Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "cinder-15a6c0f7-ae7b-445e-94f5-dccb58815b41-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-15a6c0f7-ae7b-445e-94f5-dccb58815b41-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "cinder-quobyte-15a6c0f7-ae7b-445e-94f5-dccb58815b41" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-quobyte-15a6c0f7-ae7b-445e-94f5-dccb58815b41" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-fbb6af4d-2bd7-460a-af5a-d1b920d0a772 req-b1ced5e7-e04d-4fa0-90ac-70f772b5f6c5 tempest-TestInstancesWithCinderVolumes-1968975792 None] Terminate volume connection completed successfully. Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-fbb6af4d-2bd7-460a-af5a-d1b920d0a772 req-b1ced5e7-e04d-4fa0-90ac-70f772b5f6c5 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deleting attachment 3e9d9591-df86-49dd-ae18-166bdbfdc3b4. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5825d515-705b-4a6d-b1b6-ff8c2b74546a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:06 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 Aug 24 10:07:06 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "cinder-8283f58d-04c3-4df5-ac3c-c937b1f2de19-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:07 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41" returned: 0 in 0.483s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-8283f58d-04c3-4df5-ac3c-c937b1f2de19-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:07 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41 Aug 24 10:07:07 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "cinder-quobyte-8283f58d-04c3-4df5-ac3c-c937b1f2de19" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-quobyte-8283f58d-04c3-4df5-ac3c-c937b1f2de19" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124deda-7fcc-43a6-b1db-df5f34261ee7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:07 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 Aug 24 10:07:07 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:07 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-15a6c0f7-ae7b-445e-94f5-dccb58815b41" returned: 0 in 0.323s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-quobyte-15a6c0f7-ae7b-445e-94f5-dccb58815b41" released by "delete_volume" :: held 0.867s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Created reservations ['5ea0dabc-fa6c-432c-bc53-2a2845a3e6c2', 'd6cbe0c7-cf78-45f5-a281-2ba144ebf289', '691573a0-e017-4443-bf91-3d68ce7b76be', 'daa78019-ab8f-467f-a197-d90f60dc7504'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:07 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:07 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:07 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19" returned: 0 in 0.499s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:07 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19 Aug 24 10:07:07 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "cinder-24c24abc-3ed6-482d-a087-a53a653c9db2-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-24c24abc-3ed6-482d-a087-a53a653c9db2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "cinder-quobyte-24c24abc-3ed6-482d-a087-a53a653c9db2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-quobyte-24c24abc-3ed6-482d-a087-a53a653c9db2" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80b841f-64fd-43c6-9e09-a0d1f8aecd15]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:08 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8283f58d-04c3-4df5-ac3c-c937b1f2de19" returned: 0 in 0.364s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:08 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.456s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-quobyte-8283f58d-04c3-4df5-ac3c-c937b1f2de19" released by "delete_volume" :: held 0.929s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Deleted volume successfully. Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f1921fa-bc2d-4520-9519-a035d36108b3 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-15a6c0f7-ae7b-445e-94f5-dccb58815b41-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:08 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 Aug 24 10:07:08 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:08 devstack cinder-volume[94039]: WARNING cinder.quota [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-281561102-1233789384 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-281561102-1233789384, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:07:08 devstack cinder-volume[94039]: WARNING cinder.quota [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-281561102-1233789384 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-281561102-1233789384, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Created reservations ['26cff2aa-1500-4eb9-b219-1b3918bfe116', '8e31ceee-e075-4438-badb-4c6e814c0dc6', 'bf5a42d6-9bda-49f6-b868-6dee23f209e7', '5db8f358-28b2-47dc-9521-855796c65752'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:08 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:08 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:08 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2" returned: 0 in 0.551s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:08 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2 Aug 24 10:07:08 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:08 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Deleted volume successfully. Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-385ec0a5-c136-48ae-8278-d7ae3175b0ff tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-8283f58d-04c3-4df5-ac3c-c937b1f2de19-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:08 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-24c24abc-3ed6-482d-a087-a53a653c9db2" returned: 0 in 0.315s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-quobyte-24c24abc-3ed6-482d-a087-a53a653c9db2" released by "delete_volume" :: held 0.931s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Created reservations ['f6a1a550-aa37-4f62-bfce-b4d45fc55706', 'd7284435-64bf-4747-b628-459108ec3a70', 'f0956a8b-8fd5-4dde-b46a-329480ccc74e', '0ae9ec2b-bb89-4e52-826d-f60a041d6019'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:09 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:09 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "cinder-375acf4f-bfbf-4d95-99c3-85e7a3760d75-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-375acf4f-bfbf-4d95-99c3-85e7a3760d75-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "cinder-quobyte-375acf4f-bfbf-4d95-99c3-85e7a3760d75" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-quobyte-375acf4f-bfbf-4d95-99c3-85e7a3760d75" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:09 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.370s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Deleted volume successfully. Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7131df5-90f2-48a7-9721-7c613368d81e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e43920c5-5dca-4654-9550-7102891c5dd7 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-24c24abc-3ed6-482d-a087-a53a653c9db2-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:09 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 Aug 24 10:07:09 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:10 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75" returned: 0 in 0.478s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:10 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75 Aug 24 10:07:10 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:10 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-375acf4f-bfbf-4d95-99c3-85e7a3760d75" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-quobyte-375acf4f-bfbf-4d95-99c3-85e7a3760d75" released by "delete_volume" :: held 0.864s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Created reservations ['7ded3f87-5f9c-40fa-9e0f-0767df01f85d', 'b2e9cc57-b90c-4047-b818-60bd0600abec', '34506a19-23f5-4d95-bc84-54617fd665ac', '2b8391fc-8a3a-4dbc-b14c-af87239a1e2e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:10 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:10 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:10 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.274s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Deleted volume successfully. Aug 24 10:07:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e139107a-2cdb-4f09-9dc6-6c7b5c288ac5 tempest-VolumesListTestJSON-1769688904 None] Lock "cinder-375acf4f-bfbf-4d95-99c3-85e7a3760d75-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-233cf1ec-87ec-478b-bf3d-11d33c0aa324 req-910fd714-5548-4829-ae04-b9dd5d31661e tempest-TestInstancesWithCinderVolumes-1968975792 None] Terminate volume connection completed successfully. Aug 24 10:07:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-233cf1ec-87ec-478b-bf3d-11d33c0aa324 req-910fd714-5548-4829-ae04-b9dd5d31661e tempest-TestInstancesWithCinderVolumes-1968975792 None] Deleting attachment 26167747-de3a-4f50-b1fa-69641f0a9eb4. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:07:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "cinder-910dce1a-de12-4424-aa97-64b03a4af46e-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-910dce1a-de12-4424-aa97-64b03a4af46e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "cinder-quobyte-910dce1a-de12-4424-aa97-64b03a4af46e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-quobyte-910dce1a-de12-4424-aa97-64b03a4af46e" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4975598c-fcb6-4fa2-abe9-6e050edcc571]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:12 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e Aug 24 10:07:12 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:13 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e" returned: 0 in 0.563s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:13 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e Aug 24 10:07:13 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:13 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-910dce1a-de12-4424-aa97-64b03a4af46e" returned: 0 in 0.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-quobyte-910dce1a-de12-4424-aa97-64b03a4af46e" released by "delete_volume" :: held 0.891s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:13 devstack cinder-volume[94039]: WARNING cinder.quota [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236358121-1491187564 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236358121-1491187564, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:07:13 devstack cinder-volume[94039]: WARNING cinder.quota [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236358121-1491187564 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-236358121-1491187564, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Created reservations ['6483a2f5-1d76-4aa6-b9b3-e65f24286dde', '1a964700-e59a-440d-b58d-b592a3797a3b', '34fb608c-8ad5-4583-ad97-3f62cb80ac51', 'f40bf290-559f-4280-98d1-e810a5a6e390'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:13 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:13 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:14 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.399s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:14 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deleted volume successfully. Aug 24 10:07:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-700d735e-7bca-4550-8d93-bb2a2ad27cc9 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-910dce1a-de12-4424-aa97-64b03a4af46e-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-713f0237-def6-487e-b518-141dfde5f8e9 req-f4efe9cd-9012-4703-9ad6-1de212abbee2 tempest-TestInstancesWithCinderVolumes-1968975792 None] Terminate volume connection completed successfully. Aug 24 10:07:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-713f0237-def6-487e-b518-141dfde5f8e9 req-f4efe9cd-9012-4703-9ad6-1de212abbee2 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deleting attachment 9efead35-beb0-481a-b1a7-54f6f1a8ad99. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:07:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "cinder-7e002814-0f62-4f73-a5d9-be9f21e86908-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-7e002814-0f62-4f73-a5d9-be9f21e86908-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "cinder-quobyte-7e002814-0f62-4f73-a5d9-be9f21e86908" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-quobyte-7e002814-0f62-4f73-a5d9-be9f21e86908" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5bb758-abac-4cee-a483-7352bd01864d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:23 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 Aug 24 10:07:23 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:24 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908" returned: 0 in 0.463s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:24 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908 Aug 24 10:07:24 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:24 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-7e002814-0f62-4f73-a5d9-be9f21e86908" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-quobyte-7e002814-0f62-4f73-a5d9-be9f21e86908" released by "delete_volume" :: held 0.827s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:24 devstack cinder-volume[94039]: WARNING cinder.quota [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856103428-262401259 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856103428-262401259, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:07:24 devstack cinder-volume[94039]: WARNING cinder.quota [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856103428-262401259 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-856103428-262401259, it is now deprecated. Please use the default quota class for default quota. Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Created reservations ['fc2a34f4-1bee-4475-934b-17564f1b7d1b', '797a9f86-7671-4673-8917-7b79e58cf688', '6401970e-8b40-4feb-a780-53722cd74247', '57f19bb7-6299-4ab7-b583-8e7faada35ce'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:24 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:24 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:24 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.356s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Deleted volume successfully. Aug 24 10:07:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2072c46b-49ca-42d0-9412-244699c0d427 tempest-TestInstancesWithCinderVolumes-1968975792 None] Lock "cinder-7e002814-0f62-4f73-a5d9-be9f21e86908-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:26 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:26 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:26 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.379s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:07:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (e5289133-52f9-4f06-862c-956ca0ed47f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd963b6-83bb-48ce-aa9c-4afe9298239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd963b6-83bb-48ce-aa9c-4afe9298239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-599707573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fe2b37-cab5-4ffe-8d91-32ef8c1399ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:28Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d054c145-89ac-475c-9896-973e01d6a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d054c145-89ac-475c-9896-973e01d6a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c85b4d-42ef-4c22-bc32-57ece7a48bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c85b4d-42ef-4c22-bc32-57ece7a48bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14fe2b37-cab5-4ffe-8d91-32ef8c1399ab', 'volume_name': 'volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc4b68e-68d4-465c-80cc-f6cfba199a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc4b68e-68d4-465c-80cc-f6cfba199a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3c9565-8df0-4f39-8e31-4ac99495ac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:27 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Volume 14fe2b37-cab5-4ffe-8d91-32ef8c1399ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab', 'volume_size': 1} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-599707573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fe2b37-cab5-4ffe-8d91-32ef8c1399ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:28Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Creating volume 14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:07:27 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:07:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:27 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab 1073741824 Aug 24 10:07:27 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:28 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab 1073741824" returned: 0 in 0.615s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:28 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab Aug 24 10:07:28 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:28 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" returned: 0 in 0.326s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3c9565-8df0-4f39-8e31-4ac99495ac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84faeb5d-f40f-460d-ade2-99ea37868ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:28 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Volume volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab (14fe2b37-cab5-4ffe-8d91-32ef8c1399ab): created successfully Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84faeb5d-f40f-460d-ade2-99ea37868ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (e5289133-52f9-4f06-862c-956ca0ed47f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ae5c6598-e497-418c-bc03-fcb5ce4a3146 tempest-VolumesSnapshotTestJSON-855930905 None] Created volume successfully. Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Creating offline snapshot c0d171e4-8ced-44a0-96ea-703825f21d2a of volume 14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb9fcf-ba32-4b30-88c5-89197d185143]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:30 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab Aug 24 10:07:30 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:30 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:30 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a 1G Aug 24 10:07:30 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:31 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a 1G" returned: 0 in 0.643s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:31 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a Aug 24 10:07:31 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:31 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a" returned: 0 in 0.405s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:31 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a is being set with open permissions: ugo+rw Aug 24 10:07:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:31 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a Aug 24 10:07:31 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:31 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a" returned: 0 in 0.323s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:32 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info Aug 24 10:07:32 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:32 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info" returned: 0 in 0.348s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:32 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info is being set with open permissions: ugo+rw Aug 24 10:07:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:32 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info Aug 24 10:07:32 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:32 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.info" returned: 0 in 0.430s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0068a161-01d2-4759-8fd4-33b81a74301e tempest-VolumesSnapshotTestJSON-855930905 None] Create snapshot completed successfully Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-c0d171e4-8ced-44a0-96ea-703825f21d2a-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-c0d171e4-8ced-44a0-96ea-703825f21d2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-c0d171e4-8ced-44a0-96ea-703825f21d2a" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-c0d171e4-8ced-44a0-96ea-703825f21d2a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Deleting offline snapshot c0d171e4-8ced-44a0-96ea-703825f21d2a of volume 14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] snapshot_file for this snap is: volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b69d1b-54fb-49a3-b3c2-eda6284d2f0b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:33 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a Aug 24 10:07:33 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:34 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:07:34 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079c6d0-2245-48e5-88c0-4560d010c3eb]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:34 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab Aug 24 10:07:34 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:34 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" returned: 0 in 0.539s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:34 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a Aug 24 10:07:34 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:35 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:35 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a Aug 24 10:07:35 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:35 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab.c0d171e4-8ced-44a0-96ea-703825f21d2a" returned: 0 in 0.513s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-c0d171e4-8ced-44a0-96ea-703825f21d2a" released by "_delete_snapshot" :: held 2.048s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" released by "delete_snapshot" :: held 2.076s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['334745bf-3f26-4557-a7a7-13452b98d58f', '8e4cc49b-7c41-445f-b59a-17e31cd29b99', 'e98f6d32-714e-441a-a4a3-24ce98f6490f', '2ad2f64d-fda2-4af5-8c17-efaba947ca93'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:35 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Delete snapshot completed successfully. Aug 24 10:07:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9c656f17-b20f-4488-a3e8-b742a82521d2 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-c0d171e4-8ced-44a0-96ea-703825f21d2a-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (bf891098-4904-43e3-9909-c8923b96e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6f1a22-b8df-4005-8a1d-ec6d0e4d485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b6f1a22-b8df-4005-8a1d-ec6d0e4d485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444862954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17053e2-6324-47a9-897f-12356d1b61a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:37Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3c268a-7f10-45eb-99de-e29e3e92532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f3c268a-7f10-45eb-99de-e29e3e92532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8c52a9-46fd-4aca-8138-1cfebff96c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8c52a9-46fd-4aca-8138-1cfebff96c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17053e2-6324-47a9-897f-12356d1b61a5', 'volume_name': 'volume-b17053e2-6324-47a9-897f-12356d1b61a5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944fff09-10ab-4b64-91cc-160cbd895b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944fff09-10ab-4b64-91cc-160cbd895b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac9fd54-aab3-4274-8e40-4e3dcb13736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:37 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Volume b17053e2-6324-47a9-897f-12356d1b61a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17053e2-6324-47a9-897f-12356d1b61a5', 'volume_size': 1} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1444862954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17053e2-6324-47a9-897f-12356d1b61a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:37Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Creating volume b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:07:37 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:07:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:37 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 1073741824 Aug 24 10:07:37 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:38 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 1073741824" returned: 0 in 0.631s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:38 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 Aug 24 10:07:38 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:38 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5" returned: 0 in 0.317s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac9fd54-aab3-4274-8e40-4e3dcb13736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17053e2-6324-47a9-897f-12356d1b61a5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb876d6-403d-41b0-b2eb-413c6f7f02db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:38 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Volume volume-b17053e2-6324-47a9-897f-12356d1b61a5 (b17053e2-6324-47a9-897f-12356d1b61a5): created successfully Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb876d6-403d-41b0-b2eb-413c6f7f02db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (bf891098-4904-43e3-9909-c8923b96e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:38 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-aa3f2f69-e190-47a5-ac97-70f4f876780a tempest-VolumesSnapshotTestJSON-855930905 None] Created volume successfully. Aug 24 10:07:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:39 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Creating offline snapshot 2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 of volume b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:07:39 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb98a9-c664-4efb-b0b6-1aadd9fb9afc]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:39 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 Aug 24 10:07:39 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:40 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5" returned: 0 in 0.621s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:40 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 1G Aug 24 10:07:40 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:40 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 1G" returned: 0 in 0.589s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17053e2-6324-47a9-897f-12356d1b61a5 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:41 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17053e2-6324-47a9-897f-12356d1b61a5 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 Aug 24 10:07:41 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:41 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17053e2-6324-47a9-897f-12356d1b61a5 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" returned: 0 in 0.464s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:41 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 is being set with open permissions: ugo+rw Aug 24 10:07:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:41 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 Aug 24 10:07:41 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:41 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" returned: 0 in 0.328s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:41 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info Aug 24 10:07:41 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:42 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info" returned: 0 in 0.261s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:42 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info is being set with open permissions: ugo+rw Aug 24 10:07:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:42 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info Aug 24 10:07:42 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:42 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.info" returned: 0 in 0.264s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:42 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c6b697ff-cacc-438e-836a-be3f25d3ead1 tempest-VolumesSnapshotTestJSON-855930905 None] Create snapshot completed successfully Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (ad3bc843-9b3a-47e9-b3ed-aa55c84bee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd29c099-ee8f-4a5c-8594-02fd4fb7095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd29c099-ee8f-4a5c-8594-02fd4fb7095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1324028476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0895dbb6-cbf2-45a3-9794-20a80c233f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:44Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ebc85b-4130-4b51-bd2e-9585c4ea10c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ebc85b-4130-4b51-bd2e-9585c4ea10c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a080ac2-b643-41e5-88ff-493bba3ead26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a080ac2-b643-41e5-88ff-493bba3ead26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0895dbb6-cbf2-45a3-9794-20a80c233f68', 'volume_name': 'volume-0895dbb6-cbf2-45a3-9794-20a80c233f68', 'volume_size': 2, 'snapshot_id': '2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a8c46d-9804-436d-974d-e3c32e6b991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a8c46d-9804-436d-974d-e3c32e6b991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee6550c-b40e-4376-9bf6-89ccff81415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Volume 0895dbb6-cbf2-45a3-9794-20a80c233f68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0895dbb6-cbf2-45a3-9794-20a80c233f68', 'volume_size': 2, 'snapshot_id': '2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3'} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3-0895dbb6-cbf2-45a3-9794-20a80c233f68" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3-0895dbb6-cbf2-45a3-9794-20a80c233f68" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Creating volume 0895dbb6-cbf2-45a3-9794-20a80c233f68 from snapshot 2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-0895dbb6-cbf2-45a3-9794-20a80c233f68" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-0895dbb6-cbf2-45a3-9794-20a80c233f68" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] snapshot: 2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3, volume: 0895dbb6-cbf2-45a3-9794-20a80c233f68, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3440b0-e97b-4efd-aeb3-be8e1b971f64]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:43 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 Aug 24 10:07:43 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:44 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" returned: 0 in 0.405s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17053e2-6324-47a9-897f-12356d1b61a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bf1bfa-a9f0-4c36-9161-1c3d1168ea44]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:44 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 Aug 24 10:07:44 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:44 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5" returned: 0 in 0.418s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:07:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:44 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 Aug 24 10:07:44 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:51 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68" returned: 0 in 6.361s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:07:51 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Converted 1024.00 MB image at 160.93 MB/s Aug 24 10:07:51 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 is being set with open permissions: ugo+rw Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:51 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 Aug 24 10:07:51 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:51 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68" returned: 0 in 0.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-0895dbb6-cbf2-45a3-9794-20a80c233f68" released by "_copy_volume_from_snapshot" :: held 7.538s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3-0895dbb6-cbf2-45a3-9794-20a80c233f68" released by "_create_volume_from_snapshot" :: held 7.615s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.634s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee6550c-b40e-4376-9bf6-89ccff81415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0895dbb6-cbf2-45a3-9794-20a80c233f68', 'volume_size': 2, 'snapshot_id': '2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef3712f-11ec-4cb6-935a-9f46e7c3f600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:51 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Volume volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 (0895dbb6-cbf2-45a3-9794-20a80c233f68): created successfully Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef3712f-11ec-4cb6-935a-9f46e7c3f600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (ad3bc843-9b3a-47e9-b3ed-aa55c84bee7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-93d954ec-974d-4bac-9632-624fee47d180 tempest-VolumesSnapshotTestJSON-855930905 None] Created volume successfully. Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-0895dbb6-cbf2-45a3-9794-20a80c233f68-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-0895dbb6-cbf2-45a3-9794-20a80c233f68-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-0895dbb6-cbf2-45a3-9794-20a80c233f68" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-0895dbb6-cbf2-45a3-9794-20a80c233f68" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f918e1-967e-4f82-8032-1947116b5393]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:52 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 Aug 24 10:07:52 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:52 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:52 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68 Aug 24 10:07:52 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:52 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0895dbb6-cbf2-45a3-9794-20a80c233f68" returned: 0 in 0.269s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-0895dbb6-cbf2-45a3-9794-20a80c233f68" released by "delete_volume" :: held 0.697s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['dcf08ac6-0cab-4a7c-97f9-d25e3ead91fa', '6179669b-f594-4710-87b6-9f21d4869c33', '7a2027bf-9def-4d7d-b1de-0d1998ac1405', '2d40b0cc-9f6f-4e30-8392-53b8ce8efe0d'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:52 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:52 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:53 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.358s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Deleted volume successfully. Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237873d-faca-4e72-862b-2d2c17b27eb7 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-0895dbb6-cbf2-45a3-9794-20a80c233f68-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-b17053e2-6324-47a9-897f-12356d1b61a5" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-b17053e2-6324-47a9-897f-12356d1b61a5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Deleting offline snapshot 2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 of volume b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] snapshot_file for this snap is: volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1163c264-910e-4015-8f1b-23552107d63d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:53 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 Aug 24 10:07:53 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:53 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" returned: 0 in 0.393s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17053e2-6324-47a9-897f-12356d1b61a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e8cfe-25b4-4ce3-84ca-001660ab3016]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:53 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 Aug 24 10:07:53 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:54 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5" returned: 0 in 0.605s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:54 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 Aug 24 10:07:54 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:54 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:54 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3 Aug 24 10:07:54 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:54 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5.2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:54 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3" released by "_delete_snapshot" :: held 1.837s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-b17053e2-6324-47a9-897f-12356d1b61a5" released by "delete_snapshot" :: held 1.866s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['6b215c78-915a-4f0e-8cfc-d0b1673473ef', '4c2ac0ad-6e70-4891-95dd-dbdfc38db2c9', '603e65de-6862-4b0e-8254-5ba2002437f5', '7a7305c9-49f0-42e0-accb-34177c8752d0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Delete snapshot completed successfully. Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-68e42b1a-f0cd-4a82-b676-49072c767549 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-2b2a159c-6258-4b89-9e7d-8f8a05d0e8a3-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-b17053e2-6324-47a9-897f-12356d1b61a5-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-b17053e2-6324-47a9-897f-12356d1b61a5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-b17053e2-6324-47a9-897f-12356d1b61a5" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-b17053e2-6324-47a9-897f-12356d1b61a5" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[498be0ed-4f59-42ac-97f0-1f1b8f669371]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:55 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 Aug 24 10:07:55 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:55 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5" returned: 0 in 0.420s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:56 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5 Aug 24 10:07:56 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:56 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b17053e2-6324-47a9-897f-12356d1b61a5" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-b17053e2-6324-47a9-897f-12356d1b61a5" released by "delete_volume" :: held 0.816s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['d45bc043-6d81-4673-ba23-d2b23fdc6e00', '9182d11f-26c6-4496-b8ce-41d5504863e7', 'a39c7e5e-2c97-47ec-bd2f-23e5450d025c', 'a64e63a5-e2e9-4223-b014-8d1448b5bba6'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:56 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:07:56 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:56 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.322s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:07:56 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Deleted volume successfully. Aug 24 10:07:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8f54b26-f13c-422b-8cf5-9207d866b31b tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-b17053e2-6324-47a9-897f-12356d1b61a5-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (1c0750c5-3d93-47cc-9c36-20e72a696db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71296b1d-3b85-4ea4-b764-70a910a19972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71296b1d-3b85-4ea4-b764-70a910a19972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323862499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9035e729-6238-4a67-96a7-27cb06c96d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:57Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4506a7-11f3-44cc-8f3a-17481c1f2558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4506a7-11f3-44cc-8f3a-17481c1f2558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02917078-6d41-4787-8435-afe354e22709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02917078-6d41-4787-8435-afe354e22709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9035e729-6238-4a67-96a7-27cb06c96d09', 'volume_name': 'volume-9035e729-6238-4a67-96a7-27cb06c96d09', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e89638a-6f48-4a9e-bc05-3b8ef5a82b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e89638a-6f48-4a9e-bc05-3b8ef5a82b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbc1c2c-14a8-4665-aaa8-441f7497e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Volume 9035e729-6238-4a67-96a7-27cb06c96d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9035e729-6238-4a67-96a7-27cb06c96d09', 'volume_size': 1} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1323862499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9035e729-6238-4a67-96a7-27cb06c96d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:07:57Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Creating volume 9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:07:57 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:07:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:57 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 1073741824 Aug 24 10:07:57 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:58 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 1073741824" returned: 0 in 0.597s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:58 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 Aug 24 10:07:58 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:07:58 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09" returned: 0 in 0.343s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbc1c2c-14a8-4665-aaa8-441f7497e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9035e729-6238-4a67-96a7-27cb06c96d09', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c0e2cd-d53b-41c0-bd10-e371dc7d136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:07:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Volume volume-9035e729-6238-4a67-96a7-27cb06c96d09 (9035e729-6238-4a67-96a7-27cb06c96d09): created successfully Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c0e2cd-d53b-41c0-bd10-e371dc7d136e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:07:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (1c0750c5-3d93-47cc-9c36-20e72a696db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:07:58 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6a5d4a6c-070d-4d27-8337-1a7f7de2c8f8 tempest-VolumesSnapshotTestJSON-855930905 None] Created volume successfully. Aug 24 10:07:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:07:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:07:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Creating offline snapshot 1b5420f6-d676-4097-9ed2-725bb95725fd of volume 9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:07:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e222fef7-d31c-41e1-bbbb-a2fdf854e400]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:07:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:07:59 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 Aug 24 10:07:59 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:00 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09" returned: 0 in 0.436s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:00 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd 1G Aug 24 10:08:00 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:00 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd 1G" returned: 0 in 0.453s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9035e729-6238-4a67-96a7-27cb06c96d09 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:00 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9035e729-6238-4a67-96a7-27cb06c96d09 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd Aug 24 10:08:00 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:00 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9035e729-6238-4a67-96a7-27cb06c96d09 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd" returned: 0 in 0.354s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:00 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd is being set with open permissions: ugo+rw Aug 24 10:08:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:00 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd Aug 24 10:08:00 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:01 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd" returned: 0 in 0.296s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:01 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info Aug 24 10:08:01 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:01 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info" returned: 0 in 0.289s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:01 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info is being set with open permissions: ugo+rw Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:01 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info Aug 24 10:08:01 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:01 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.info" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Flow 'volume_create_manager' (3b7bfbc6-ad10-4511-b8c0-ea45e0632daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b3fc3-b356-4517-8f48-bf602677193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f6c31c3-ed5f-4b78-b242-43e86b585a3c tempest-VolumesSnapshotTestJSON-855930905 None] Create snapshot completed successfully Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08b3fc3-b356-4517-8f48-bf602677193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-901784008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8fb8f5-101e-480d-8012-472ccc257ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9709674d2427887a787a746c4c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:02Z,use_quota=True,user_id='ac9c61848186432db8c3db29e8bd45ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930b78fa-4880-4141-9a5f-0abc4f846b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (930b78fa-4880-4141-9a5f-0abc4f846b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab82d428-c6bc-487b-82d5-deaa4d95d429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab82d428-c6bc-487b-82d5-deaa4d95d429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8fb8f5-101e-480d-8012-472ccc257ce0', 'volume_name': 'volume-6f8fb8f5-101e-480d-8012-472ccc257ce0', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc98724-7683-4abd-8d2e-d367a13376b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc98724-7683-4abd-8d2e-d367a13376b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade8d138-5768-48a7-9a6c-b59d320b8325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:01 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Volume 6f8fb8f5-101e-480d-8012-472ccc257ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8fb8f5-101e-480d-8012-472ccc257ce0', 'volume_size': 1} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-901784008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8fb8f5-101e-480d-8012-472ccc257ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac9709674d2427887a787a746c4c05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:02Z,use_quota=True,user_id='ac9c61848186432db8c3db29e8bd45ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Creating volume 6f8fb8f5-101e-480d-8012-472ccc257ce0 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:08:01 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:08:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:02 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 1073741824 Aug 24 10:08:02 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:02 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 1073741824" returned: 0 in 0.513s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:02 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 Aug 24 10:08:02 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:02 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0" returned: 0 in 0.263s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade8d138-5768-48a7-9a6c-b59d320b8325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8fb8f5-101e-480d-8012-472ccc257ce0', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61b5ce5-8e37-44d8-a413-1d7964c6279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Volume volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 (6f8fb8f5-101e-480d-8012-472ccc257ce0): created successfully Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61b5ce5-8e37-44d8-a413-1d7964c6279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Flow 'volume_create_manager' (3b7bfbc6-ad10-4511-b8c0-ea45e0632daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-42e886a7-c65e-478e-94b9-38b28e483ebf tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Created volume successfully. Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:INSERT=27,cinder:UPDATE=98,cinder:DELETE=8,cinder:SELECT=78 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=98,cinder:SELECT=88,cinder:INSERT=22,cinder:DELETE=9 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (6d90cd63-363c-4e59-a02a-4989404e4c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc10e14-7993-48bd-9338-31d7499722f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc10e14-7993-48bd-9338-31d7499722f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1091854336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2479283-0e25-48fd-9fd6-8c727d5778ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cbfec427f9a453eac1f5dba95a90f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b5420f6-d676-4097-9ed2-725bb95725fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:03Z,use_quota=True,user_id='515f7d626d484a67acf26fcd701be926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d581b9-a1e1-43df-b2db-ca1eac70d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d581b9-a1e1-43df-b2db-ca1eac70d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1a52d5-d9e1-49fb-becc-ac0c4cbccb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1a52d5-d9e1-49fb-becc-ac0c4cbccb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2479283-0e25-48fd-9fd6-8c727d5778ea', 'volume_name': 'volume-c2479283-0e25-48fd-9fd6-8c727d5778ea', 'volume_size': 1, 'snapshot_id': '1b5420f6-d676-4097-9ed2-725bb95725fd'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05bbabe-80ef-4e8a-a383-d43cd46ff740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05bbabe-80ef-4e8a-a383-d43cd46ff740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a9dbfa-f4b2-45d1-9c86-93deb71bf8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Volume c2479283-0e25-48fd-9fd6-8c727d5778ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2479283-0e25-48fd-9fd6-8c727d5778ea', 'volume_size': 1, 'snapshot_id': '1b5420f6-d676-4097-9ed2-725bb95725fd'} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-1b5420f6-d676-4097-9ed2-725bb95725fd-c2479283-0e25-48fd-9fd6-8c727d5778ea" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-1b5420f6-d676-4097-9ed2-725bb95725fd-c2479283-0e25-48fd-9fd6-8c727d5778ea" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Creating volume c2479283-0e25-48fd-9fd6-8c727d5778ea from snapshot 1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-c2479283-0e25-48fd-9fd6-8c727d5778ea" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-c2479283-0e25-48fd-9fd6-8c727d5778ea" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] snapshot: 1b5420f6-d676-4097-9ed2-725bb95725fd, volume: c2479283-0e25-48fd-9fd6-8c727d5778ea, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e545797d-daeb-4e15-9b86-2a50b0a3a3b5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:03 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd Aug 24 10:08:03 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:04 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9035e729-6238-4a67-96a7-27cb06c96d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea2a7f-1237-495f-9fc3-5fd04133b673]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:04 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 Aug 24 10:08:04 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:04 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09" returned: 0 in 0.479s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:08:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:04 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea Aug 24 10:08:04 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-557a3e29-e917-4c7c-82a5-a099059a2254 req-92f849a7-971c-46f7-ac91-5fbb6b8b36c7 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:10 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea" returned: 0 in 5.561s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:08:10 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Converted 1024.00 MB image at 184.02 MB/s Aug 24 10:08:10 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea is being set with open permissions: ugo+rw Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:10 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea Aug 24 10:08:10 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:10 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-c2479283-0e25-48fd-9fd6-8c727d5778ea" released by "_copy_volume_from_snapshot" :: held 6.846s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-1b5420f6-d676-4097-9ed2-725bb95725fd-c2479283-0e25-48fd-9fd6-8c727d5778ea" released by "_create_volume_from_snapshot" :: held 6.982s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.036s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-557a3e29-e917-4c7c-82a5-a099059a2254 req-92f849a7-971c-46f7-ac91-5fbb6b8b36c7 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.935s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-557a3e29-e917-4c7c-82a5-a099059a2254 req-92f849a7-971c-46f7-ac91-5fbb6b8b36c7 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a9dbfa-f4b2-45d1-9c86-93deb71bf8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2479283-0e25-48fd-9fd6-8c727d5778ea', 'volume_size': 1, 'snapshot_id': '1b5420f6-d676-4097-9ed2-725bb95725fd'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723192a7-a2a7-4a9c-b883-1277f0b44b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Volume volume-c2479283-0e25-48fd-9fd6-8c727d5778ea (c2479283-0e25-48fd-9fd6-8c727d5778ea): created successfully Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723192a7-a2a7-4a9c-b883-1277f0b44b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Flow 'volume_create_manager' (6d90cd63-363c-4e59-a02a-4989404e4c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-557a3e29-e917-4c7c-82a5-a099059a2254 req-92f849a7-971c-46f7-ac91-5fbb6b8b36c7 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-6f8fb8f5-101e-480d-8012-472ccc257ce0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6708139-6b79-4faf-9f7a-8af478a08281', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:08:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-3f277321-a4d1-4672-8fe2-1ff3348fe81d tempest-VolumesSnapshotTestJSON-855930905 None] Created volume successfully. Aug 24 10:08:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-557a3e29-e917-4c7c-82a5-a099059a2254 req-92f849a7-971c-46f7-ac91-5fbb6b8b36c7 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] attachment_update completed successfully. Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-c2479283-0e25-48fd-9fd6-8c727d5778ea-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-c2479283-0e25-48fd-9fd6-8c727d5778ea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-c2479283-0e25-48fd-9fd6-8c727d5778ea" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-c2479283-0e25-48fd-9fd6-8c727d5778ea" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bb2ec8-5ec6-46cf-9d1b-0237b7dd892c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Flow 'volume_create_manager' (edf94c2b-ef32-48cf-814d-15cb47bdf24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc6cc8c-5e1c-4766-938c-3bafc3288c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc6cc8c-5e1c-4766-938c-3bafc3288c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1078294424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbb01a1-2285-4ae5-92c8-dcc37c680167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7f727459dd4a78ab197785aa9aa625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:12Z,use_quota=True,user_id='0d68ca331d3f419791f399f81ce028bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d909c2-a97a-43fd-bdbc-f60ced20ad57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d909c2-a97a-43fd-bdbc-f60ced20ad57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f4cc92-e58a-4f1d-8da9-47cbadd77001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f4cc92-e58a-4f1d-8da9-47cbadd77001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbb01a1-2285-4ae5-92c8-dcc37c680167', 'volume_name': 'volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc236776-88ba-4115-b94e-0438f82bf9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:11 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea Aug 24 10:08:11 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc236776-88ba-4115-b94e-0438f82bf9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6715b190-f3f1-4afa-9483-75d5901b3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Volume 4fbb01a1-2285-4ae5-92c8-dcc37c680167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167', 'volume_size': 1} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1078294424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbb01a1-2285-4ae5-92c8-dcc37c680167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c7f727459dd4a78ab197785aa9aa625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:12Z,use_quota=True,user_id='0d68ca331d3f419791f399f81ce028bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Creating volume 4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:08:11 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:08:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:11 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 1073741824 Aug 24 10:08:11 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:12 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea" returned: 0 in 0.456s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:12 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea Aug 24 10:08:12 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:12 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 1073741824" returned: 0 in 0.512s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:12 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c2479283-0e25-48fd-9fd6-8c727d5778ea" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:12 devstack sudo[109494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 Aug 24 10:08:12 devstack sudo[109494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-c2479283-0e25-48fd-9fd6-8c727d5778ea" released by "delete_volume" :: held 0.784s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['841b7809-fb4a-4360-8cc8-71593c30eb7c', '30003e6f-4642-426a-8dc9-0ed4d664ea4d', 'f5bee077-fa94-4f0e-aefa-8d7263df8f7d', 'bc1f45f0-a68b-4405-a29c-f71720670c39'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:12 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:08:12 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:12 devstack sudo[109494]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167" returned: 0 in 0.298s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6715b190-f3f1-4afa-9483-75d5901b3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3cfd5e-7d90-4aa2-a88e-086fa7cfdc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:12 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Volume volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 (4fbb01a1-2285-4ae5-92c8-dcc37c680167): created successfully Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3cfd5e-7d90-4aa2-a88e-086fa7cfdc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Flow 'volume_create_manager' (edf94c2b-ef32-48cf-814d-15cb47bdf24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0ea9782b-df3c-42de-8e9e-9e6d2345ad80 tempest-TestImageHashVerification-564525824 None] Created volume successfully. Aug 24 10:08:12 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.265s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:08:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Deleted volume successfully. Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-1b5420f6-d676-4097-9ed2-725bb95725fd-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-edff02ca-5962-436d-b012-3fa4f4f2f7cc tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-c2479283-0e25-48fd-9fd6-8c727d5778ea-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-1b5420f6-d676-4097-9ed2-725bb95725fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-9035e729-6238-4a67-96a7-27cb06c96d09" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-9035e729-6238-4a67-96a7-27cb06c96d09" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-1b5420f6-d676-4097-9ed2-725bb95725fd" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-1b5420f6-d676-4097-9ed2-725bb95725fd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Deleting offline snapshot 1b5420f6-d676-4097-9ed2-725bb95725fd of volume 9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] snapshot_file for this snap is: volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[36810d2f-ed57-4f58-895a-d5b78f6075bf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:12 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd Aug 24 10:08:12 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:13 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd" returned: 0 in 0.383s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9035e729-6238-4a67-96a7-27cb06c96d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d22438-6b39-4a71-a95d-2e0b6d33ad8e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:13 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 Aug 24 10:08:13 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-1f488c4d-7886-4221-8540-1b1758b76cb6 req-0f401be8-022c-4166-ad99-d41b092b1e55 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Terminate volume connection completed successfully. Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-1f488c4d-7886-4221-8540-1b1758b76cb6 req-0f401be8-022c-4166-ad99-d41b092b1e55 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Deleting attachment e6708139-6b79-4faf-9f7a-8af478a08281. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:08:13 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09" returned: 0 in 0.608s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:13 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd Aug 24 10:08:13 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:14 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd" returned: 0 in 0.380s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:14 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd Aug 24 10:08:14 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Acquiring lock "cinder-6f8fb8f5-101e-480d-8012-472ccc257ce0-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "cinder-6f8fb8f5-101e-480d-8012-472ccc257ce0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Acquiring lock "cinder-quobyte-6f8fb8f5-101e-480d-8012-472ccc257ce0" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "cinder-quobyte-6f8fb8f5-101e-480d-8012-472ccc257ce0" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:14 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09.1b5420f6-d676-4097-9ed2-725bb95725fd" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e1b71-25bd-4f19-9e4e-ed6659db35e3]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-1b5420f6-d676-4097-9ed2-725bb95725fd" released by "_delete_snapshot" :: held 1.848s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-9035e729-6238-4a67-96a7-27cb06c96d09" released by "delete_snapshot" :: held 1.888s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:14 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 Aug 24 10:08:14 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['e94c8bf2-0c89-459d-b4d9-b635a55910f1', '60baf46b-7370-41a8-b696-f18b027fcea1', '0f0b381e-ed91-4e00-857f-aeb2da148eea', 'bb0db45d-ba72-4f30-b584-7599f5e2d90c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Delete snapshot completed successfully. Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-e0d68767-a92b-46ac-8588-75cd9c2d5603 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-1b5420f6-d676-4097-9ed2-725bb95725fd-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8dcad6-9383-45f7-bd2c-ed8eb4a1faee]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:15 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 Aug 24 10:08:15 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:15 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0" returned: 0 in 0.470s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-9035e729-6238-4a67-96a7-27cb06c96d09-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-9035e729-6238-4a67-96a7-27cb06c96d09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:15 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0 Aug 24 10:08:15 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-9035e729-6238-4a67-96a7-27cb06c96d09" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-9035e729-6238-4a67-96a7-27cb06c96d09" acquired by "delete_volume" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23eef57-fccb-4545-92b2-2f6117862903]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:15 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167" returned: 0 in 0.479s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[956eac45-ba7c-42ab-9905-5b7230eabc78]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:15 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 Aug 24 10:08:15 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:15 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6f8fb8f5-101e-480d-8012-472ccc257ce0" returned: 0 in 0.342s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "cinder-quobyte-6f8fb8f5-101e-480d-8012-472ccc257ce0" released by "delete_volume" :: held 0.889s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Created reservations ['30af7176-7773-4514-ba9e-d09523b3476e', 'dc6d2664-a201-4e74-8ebe-d067834cbe83', '0bd5a745-60f7-4829-a405-6f1691b38a31', 'cde4ac6d-4759-44d8-8d2d-98c839822ecf'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:15 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 Aug 24 10:08:15 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:15 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:08:15 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:15 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09" returned: 0 in 0.550s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:15 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09 Aug 24 10:08:15 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:15 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167" returned: 0 in 0.527s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 /opt/stack/data/cinder/conversion/4fbb01a1-2285-4ae5-92c8-dcc37c680167.temp_image.e38e1cc3-0cdc-483c-a258-6a196e9858dfi83mt27b.img {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:16 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.377s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:08:16 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 /opt/stack/data/cinder/conversion/4fbb01a1-2285-4ae5-92c8-dcc37c680167.temp_image.e38e1cc3-0cdc-483c-a258-6a196e9858dfi83mt27b.img Aug 24 10:08:16 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Deleted volume successfully. Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-465784ad-e9e1-4a95-996d-b9dce27db116 tempest-TestServerVolumeAttachScenarioOldVersion-181413749 None] Lock "cinder-6f8fb8f5-101e-480d-8012-472ccc257ce0-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:16 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035e729-6238-4a67-96a7-27cb06c96d09" returned: 0 in 0.347s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-9035e729-6238-4a67-96a7-27cb06c96d09" released by "delete_volume" :: held 0.993s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['eba9bcd5-e559-43fc-930d-d9479199c229', '387d747c-e920-4bc8-985e-1bf511f8c5fe', 'cbe719e2-4d2b-4c50-8cc8-6f15247ef734', '788d8545-3912-45cd-96c5-051bd96f5f61'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:16 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:08:16 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:17 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.838s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:17 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:08:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Deleted volume successfully. Aug 24 10:08:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-332192c3-46a3-48af-887f-b2ddacbf87ba tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-9035e729-6238-4a67-96a7-27cb06c96d09-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "cinder-quobyte-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" acquired by "delete_volume" :: waited 0.045s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1fc14b-a899-425c-addd-1d962d418457]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:18 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab Aug 24 10:08:18 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:19 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" returned: 0 in 0.984s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:19 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab Aug 24 10:08:19 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:19 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" returned: 0 in 0.567s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-quobyte-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab" released by "delete_volume" :: held 1.744s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:19 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Created reservations ['1e3e4ede-5a73-4826-b272-cfa600f0028b', 'b91a8485-3b89-439a-8b44-157fb9b99e8b', 'c9272209-86e0-4e9e-b064-24e227415502', '38efef06-6442-4992-9025-c866ecb1c0c5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:20 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:08:20 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:20 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.592s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:08:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Deleted volume successfully. Aug 24 10:08:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ba80c6c4-4dcc-478a-9e70-435849801238 tempest-VolumesSnapshotTestJSON-855930905 None] Lock "cinder-14fe2b37-cab5-4ffe-8d91-32ef8c1399ab-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:21 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 /opt/stack/data/cinder/conversion/4fbb01a1-2285-4ae5-92c8-dcc37c680167.temp_image.e38e1cc3-0cdc-483c-a258-6a196e9858dfi83mt27b.img" returned: 0 in 5.941s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddd8d50-c530-4192-ae80-08a2e6cf5b72]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:22 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 Aug 24 10:08:22 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:22 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167" returned: 0 in 0.657s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:22 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/conversion/4fbb01a1-2285-4ae5-92c8-dcc37c680167.temp_image.e38e1cc3-0cdc-483c-a258-6a196e9858dfi83mt27b.img {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:08:22 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Converted 1024.00 MB image at 172.33 MB/s Aug 24 10:08:22 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] e38e1cc3-0cdc-483c-a258-6a196e9858df was raw, no need to convert to raw {{(pid=94039) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:26 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:08:26 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:26 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.421s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:08:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:08:29 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:08:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Flow 'volume_create_manager' (4037dd4b-363d-4d33-b790-30e9f30d98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11231034-c5bf-4292-8d42-87dc227a29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11231034-c5bf-4292-8d42-87dc227a29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-263619263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addb874c-f858-4421-9a8b-06ba090d0bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929091fe850948d5b8aaea8c782ffb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:30Z,use_quota=True,user_id='eebc616d168c4f049158a23a5e4566d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deb9b36-1056-4ebe-87c9-2e5ef71ed222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1deb9b36-1056-4ebe-87c9-2e5ef71ed222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616d8ef7-a0a5-49bb-a65b-480e183c854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616d8ef7-a0a5-49bb-a65b-480e183c854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addb874c-f858-4421-9a8b-06ba090d0bea', 'volume_name': 'volume-addb874c-f858-4421-9a8b-06ba090d0bea', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d47055-f714-4170-834c-3e6e69ce22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d47055-f714-4170-834c-3e6e69ce22e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d48756-2263-4348-91df-1a920be6f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:30 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Volume addb874c-f858-4421-9a8b-06ba090d0bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addb874c-f858-4421-9a8b-06ba090d0bea', 'volume_size': 1} Aug 24 10:08:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=36,cinder:UPDATE=44,cinder:INSERT=13,cinder:DELETE=2 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:08:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=45,cinder:UPDATE=46,cinder:DELETE=4,cinder:INSERT=9 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.259s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Uploaded volume to glance image-id: e38e1cc3-0cdc-483c-a258-6a196e9858df. {{(pid=94039) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.112s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-263619263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addb874c-f858-4421-9a8b-06ba090d0bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929091fe850948d5b8aaea8c782ffb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:08:30Z,use_quota=True,user_id='eebc616d168c4f049158a23a5e4566d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Creating volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:08:44 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-896c38ed-d2f1-4117-bc4d-0aee807a5304 tempest-TestImageHashVerification-564525824 None] Copy volume to image completed successfully. Aug 24 10:08:44 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea 1073741824 Aug 24 10:08:44 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:44 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea 1073741824" returned: 0 in 0.650s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:44 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea Aug 24 10:08:44 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Acquiring lock "cinder-4fbb01a1-2285-4ae5-92c8-dcc37c680167-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Lock "cinder-4fbb01a1-2285-4ae5-92c8-dcc37c680167-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Acquiring lock "cinder-quobyte-4fbb01a1-2285-4ae5-92c8-dcc37c680167" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Lock "cinder-quobyte-4fbb01a1-2285-4ae5-92c8-dcc37c680167" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b4cb7f-e821-462e-b56f-b4d585ba1ce7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:45 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea" returned: 0 in 0.376s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d48756-2263-4348-91df-1a920be6f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addb874c-f858-4421-9a8b-06ba090d0bea', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798ccb42-1109-498f-97fc-70c9c55a69b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:08:45 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Volume volume-addb874c-f858-4421-9a8b-06ba090d0bea (addb874c-f858-4421-9a8b-06ba090d0bea): created successfully Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798ccb42-1109-498f-97fc-70c9c55a69b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Flow 'volume_create_manager' (4037dd4b-363d-4d33-b790-30e9f30d98f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:08:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-aa48493e-7e54-4699-a082-ecb35d52b9dc tempest-VolumesSnapshotListTestJSON-700637514 None] Created volume successfully. Aug 24 10:08:45 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 Aug 24 10:08:45 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:45 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:45 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167 Aug 24 10:08:45 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:45 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4fbb01a1-2285-4ae5-92c8-dcc37c680167" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Lock "cinder-quobyte-4fbb01a1-2285-4ae5-92c8-dcc37c680167" released by "delete_volume" :: held 0.755s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:45 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Created reservations ['0c6dd09c-1f59-43a5-b95a-7412a3fd5a0d', '9805a8f6-a217-4929-8c01-0cb78e464fd3', 'ce9f183f-ec24-4f80-9999-3aa8a3994c46', '8d1361e6-f680-4e72-87a0-eecfc5b9d025'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:46 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:08:46 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:46 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.371s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:08:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Deleted volume successfully. Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Creating offline snapshot c43a42b9-9dea-4d00-a188-fbe40123fcd3 of volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-23e05fab-f4e9-4ea2-a2bc-f1149be5d822 tempest-TestImageHashVerification-564525824 None] Lock "cinder-4fbb01a1-2285-4ae5-92c8-dcc37c680167-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e9d02c-8be2-4d19-bbe1-293343d4888b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:46 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea Aug 24 10:08:46 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:46 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea" returned: 0 in 0.466s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:47 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 1G Aug 24 10:08:47 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:47 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 1G" returned: 0 in 0.561s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:47 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:08:47 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:47 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.401s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:47 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 is being set with open permissions: ugo+rw Aug 24 10:08:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:47 devstack sudo[109736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:08:47 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:48 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:48 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info Aug 24 10:08:48 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:48 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:48 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info is being set with open permissions: ugo+rw Aug 24 10:08:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:48 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info Aug 24 10:08:48 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:48 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.info" returned: 0 in 0.293s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-737d5f28-1fae-41e9-a163-ddfe2bd2d03d tempest-VolumesSnapshotListTestJSON-700637514 None] Create snapshot completed successfully Aug 24 10:08:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Creating offline snapshot 094e1867-61f6-4d8e-b888-d70f91860d13 of volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:08:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9270be3-a10c-4c5a-b6b5-ae5670b04e23]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:50 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:08:50 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:50 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:08:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:50 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 1G Aug 24 10:08:50 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:50 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 1G" returned: 0 in 0.548s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:50 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:08:50 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:51 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.436s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:51 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 is being set with open permissions: ugo+rw Aug 24 10:08:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:51 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:08:51 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:51 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.265s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.759s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4aae7ba6-62e7-4546-a094-af14ca209563 tempest-VolumesSnapshotListTestJSON-700637514 None] Create snapshot completed successfully Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Creating offline snapshot 7bed9edf-732d-4abb-b838-3795b0f4bce0 of volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b12b2-655c-451f-8b10-dfe0f9227dbc]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:52 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:08:52 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:52 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:08:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:52 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 1G Aug 24 10:08:52 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:53 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 1G" returned: 0 in 0.589s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:53 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 Aug 24 10:08:53 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:53 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0" returned: 0 in 0.473s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:53 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 is being set with open permissions: ugo+rw Aug 24 10:08:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:53 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 Aug 24 10:08:53 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:54 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:08:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-886d08bf-c3df-4258-9ecc-c8d815db678b tempest-VolumesSnapshotListTestJSON-700637514 None] Create snapshot completed successfully Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-7bed9edf-732d-4abb-b838-3795b0f4bce0-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-7bed9edf-732d-4abb-b838-3795b0f4bce0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-7bed9edf-732d-4abb-b838-3795b0f4bce0" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-7bed9edf-732d-4abb-b838-3795b0f4bce0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Deleting offline snapshot 7bed9edf-732d-4abb-b838-3795b0f4bce0 of volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] snapshot_file for this snap is: volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[495d8765-2661-4232-aaa9-8e0fcf962625]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:56 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 Aug 24 10:08:56 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:56 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0" returned: 0 in 0.433s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c3c318-4c2a-41fb-88ce-0f53449cbc19]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:56 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:08:57 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:57 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:08:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:57 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 Aug 24 10:08:57 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:57 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0" returned: 0 in 0.633s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:58 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0 Aug 24 10:08:58 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:08:58 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Aug 24 10:08:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.7bed9edf-732d-4abb-b838-3795b0f4bce0" returned: 0 in 0.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:08:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-7bed9edf-732d-4abb-b838-3795b0f4bce0" released by "_delete_snapshot" :: held 1.968s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" released by "delete_snapshot" :: held 1.993s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:58 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Created reservations ['4a5221e5-43dd-4691-af9e-5c0b447c0ee4', '742e23b4-d3f9-4ff0-a4ca-8ebd25c8d56f', '4c931afb-0557-4bda-bc24-1d27417d1258', '5376ac7b-389b-4a31-9782-cceb8da69bb7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:08:58 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Delete snapshot completed successfully. Aug 24 10:08:58 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbca1483-28ec-4198-a007-6a3328f278e6 tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-7bed9edf-732d-4abb-b838-3795b0f4bce0-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-094e1867-61f6-4d8e-b888-d70f91860d13-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-094e1867-61f6-4d8e-b888-d70f91860d13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-094e1867-61f6-4d8e-b888-d70f91860d13" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-094e1867-61f6-4d8e-b888-d70f91860d13" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Deleting offline snapshot 094e1867-61f6-4d8e-b888-d70f91860d13 of volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] snapshot_file for this snap is: volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5f65a0-80bc-45fc-82e5-361aaefee01e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:08:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:08:59 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:08:59 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:00 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.497s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67b041d-ecd5-4d16-acdb-3303443f174d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:00 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:09:00 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:00 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.527s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:09:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:00 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:09:00 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:01 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.502s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:01 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13 Aug 24 10:09:01 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:01 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.094e1867-61f6-4d8e-b888-d70f91860d13" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-094e1867-61f6-4d8e-b888-d70f91860d13" released by "_delete_snapshot" :: held 1.960s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" released by "delete_snapshot" :: held 1.991s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Created reservations ['96c5b9f1-6c85-4c12-b8bd-ac55a4295c6b', 'd00996e3-4c13-48ec-bff6-b027c5195096', 'ccf223c2-74a6-43a5-a492-c1bd5908b0b7', '7043432b-915a-4f3f-96b3-e5151dc8504a'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Flow 'volume_create_manager' (f7a0c763-0978-4e48-ab71-a020dae68df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd632789-3777-492f-aa23-ab1b56c3afc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd632789-3777-492f-aa23-ab1b56c3afc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1316815541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3db0d31-e58a-44d5-9ff0-75130e5f8264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6932dc12a5442aa0ad14cf41b55370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:02Z,use_quota=True,user_id='ce068adbb9d948c19e47075f54c17217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6302c3-e1ad-4556-bdbb-c20ae76bbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6302c3-e1ad-4556-bdbb-c20ae76bbba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4418b21f-58f5-41a5-9321-fe31487e4280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4418b21f-58f5-41a5-9321-fe31487e4280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3db0d31-e58a-44d5-9ff0-75130e5f8264', 'volume_name': 'volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6dcb8c-8628-4acd-9742-02dc1e6b3296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6dcb8c-8628-4acd-9742-02dc1e6b3296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0889b91c-d444-4529-babb-ef508dc2f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:01 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Volume f3db0d31-e58a-44d5-9ff0-75130e5f8264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264', 'volume_size': 1} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1316815541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3db0d31-e58a-44d5-9ff0-75130e5f8264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6932dc12a5442aa0ad14cf41b55370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:02Z,use_quota=True,user_id='ce068adbb9d948c19e47075f54c17217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Creating volume f3db0d31-e58a-44d5-9ff0-75130e5f8264 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:01 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:01 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 1073741824 Aug 24 10:09:01 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Delete snapshot completed successfully. Aug 24 10:09:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-74207385-6b52-49df-82fa-1e1637eb56fd tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-094e1867-61f6-4d8e-b888-d70f91860d13-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Flow 'volume_create_manager' (c34913ef-65fe-4a33-9090-a6721241d5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb303d6b-9eb5-4511-bfbb-43e92d8354b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb303d6b-9eb5-4511-bfbb-43e92d8354b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1275467973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bac69e-b9c6-4516-b173-61db6ebd5301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6932dc12a5442aa0ad14cf41b55370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:02Z,use_quota=True,user_id='ce068adbb9d948c19e47075f54c17217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e7342d-817a-4a0b-85b2-6b647794a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e7342d-817a-4a0b-85b2-6b647794a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8386c4c5-3a20-4788-90fe-ac82bd60d28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8386c4c5-3a20-4788-90fe-ac82bd60d28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bac69e-b9c6-4516-b173-61db6ebd5301', 'volume_name': 'volume-63bac69e-b9c6-4516-b173-61db6ebd5301', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6cdb7f-f6a5-4b51-b763-0b0d0989f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6cdb7f-f6a5-4b51-b763-0b0d0989f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe26244-56db-4d3d-8344-cb1821592ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Volume 63bac69e-b9c6-4516-b173-61db6ebd5301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bac69e-b9c6-4516-b173-61db6ebd5301', 'volume_size': 1} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:02 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 1073741824" returned: 0 in 0.611s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:02 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 Aug 24 10:09:02 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:02 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1275467973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bac69e-b9c6-4516-b173-61db6ebd5301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce6932dc12a5442aa0ad14cf41b55370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:02Z,use_quota=True,user_id='ce068adbb9d948c19e47075f54c17217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Creating volume 63bac69e-b9c6-4516-b173-61db6ebd5301 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:02 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-c43a42b9-9dea-4d00-a188-fbe40123fcd3-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0889b91c-d444-4529-babb-ef508dc2f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b493eda-2073-4394-ab41-e9c6a9d26ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:02 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 1073741824 Aug 24 10:09:02 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Volume volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 (f3db0d31-e58a-44d5-9ff0-75130e5f8264): created successfully Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b493eda-2073-4394-ab41-e9c6a9d26ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Flow 'volume_create_manager' (f7a0c763-0978-4e48-ab71-a020dae68df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-c43a42b9-9dea-4d00-a188-fbe40123fcd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ce548c3e-b389-493e-a954-cf0bf91f13cc tempest-TestServerVolumeAttachmentScenario-2048157672 None] Created volume successfully. Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-c43a42b9-9dea-4d00-a188-fbe40123fcd3" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-c43a42b9-9dea-4d00-a188-fbe40123fcd3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Deleting offline snapshot c43a42b9-9dea-4d00-a188-fbe40123fcd3 of volume addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] snapshot_file for this snap is: volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4de69f-67f2-45eb-9c2d-7f138105068d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:03 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:09:03 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:03 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 1073741824" returned: 0 in 0.688s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:03 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 Aug 24 10:09:03 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:03 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.524s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addb874c-f858-4421-9a8b-06ba090d0bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f917e4-c941-445b-9272-75ec0fadc94d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:03 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea Aug 24 10:09:03 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:03 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301" returned: 0 in 0.355s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe26244-56db-4d3d-8344-cb1821592ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bac69e-b9c6-4516-b173-61db6ebd5301', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60e69af-118b-46a3-b94d-3143ec37e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:03 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Volume volume-63bac69e-b9c6-4516-b173-61db6ebd5301 (63bac69e-b9c6-4516-b173-61db6ebd5301): created successfully Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60e69af-118b-46a3-b94d-3143ec37e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:03 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Flow 'volume_create_manager' (c34913ef-65fe-4a33-9090-a6721241d5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:03 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b1d9ebba-4355-4236-a2e2-8786c283a9d6 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Created volume successfully. Aug 24 10:09:04 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea" returned: 0 in 0.533s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:04 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:04 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Flow 'volume_create_manager' (b1f8d8b0-e6a2-4b34-9873-40c591f1c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9971c50e-60c0-4f2f-9dbd-f742b7e8ee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9971c50e-60c0-4f2f-9dbd-f742b7e8ee33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef757b6-bd12-40bf-b9c7-bc41b4a8664f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58499f4c01da46119e9529478839138c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:04Z,use_quota=True,user_id='7b3f0cceed3a4b77b940d68138a0247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9273ad3-2430-46c4-b027-421e5e80e4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9273ad3-2430-46c4-b027-421e5e80e4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad99fd88-954a-48e3-aa41-4b903f5173c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad99fd88-954a-48e3-aa41-4b903f5173c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ef757b6-bd12-40bf-b9c7-bc41b4a8664f', 'volume_name': 'volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f', 'volume_size': 1, 'image_id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fad15c8-3629-4fd1-94b5-f014160c8d25', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6df49b717f69e65d49e54423b580588', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58499f4c01da46119e9529478839138c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20e17e898757192151ed22254905f5bbea4816b14d7c3c045577a6d56d29abba9e2f1403b9f0d7f9ea071f40c9a343f3815f6ba07936922c641bf340f30e7487', 'id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'created_at': datetime.datetime(2026, 8, 24, 8, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fad15c8-3629-4fd1-94b5-f014160c8d25/file', 'properties': {}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea20940-56b8-43d8-a625-e847cda28ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea20940-56b8-43d8-a625-e847cda28ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7e092c-da41-4d0d-b5c4-45c3031e27e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Volume 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f', 'volume_size': 1, 'image_id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fad15c8-3629-4fd1-94b5-f014160c8d25', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6df49b717f69e65d49e54423b580588', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58499f4c01da46119e9529478839138c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20e17e898757192151ed22254905f5bbea4816b14d7c3c045577a6d56d29abba9e2f1403b9f0d7f9ea071f40c9a343f3815f6ba07936922c641bf340f30e7487', 'id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'created_at': datetime.datetime(2026, 8, 24, 8, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fad15c8-3629-4fd1-94b5-f014160c8d25/file', 'properties': {}}, 'image_service': } Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Trying to clone 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f from image 0fad15c8-3629-4fd1-94b5-f014160c8d25 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0fad15c8-3629-4fd1-94b5-f014160c8d25', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:09:04 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:04 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3 Aug 24 10:09:04 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:09:04 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Image download 0.00 MB at 0.00 MB/s Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f4047-393a-4300-b9a9-97dde035ea4d]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:04 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:04 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea.c43a42b9-9dea-4d00-a188-fbe40123fcd3" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:04 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-c43a42b9-9dea-4d00-a188-fbe40123fcd3" released by "_delete_snapshot" :: held 1.941s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" released by "delete_snapshot" :: held 1.978s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Created reservations ['54066986-36b4-4f81-b127-7e222bbf3e73', 'ea6677b7-417a-4092-9e5a-4d6645e1c03c', 'dc56fed7-7c27-4a63-baae-9a51a3892e0a', 'f6a84cb5-af80-48eb-8e85-5dcb4fb64cfc'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:09:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Delete snapshot completed successfully. Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff399d05-6765-42ae-a096-906717a2d60d tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-c43a42b9-9dea-4d00-a188-fbe40123fcd3-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:05 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:05 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD Aug 24 10:09:05 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:05 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Temporary image 0fad15c8-3629-4fd1-94b5-f014160c8d25 is fetched for user 7b3f0cceed3a4b77b940d68138a0247c. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa521d6-69ac-4011-ac1c-4c4e02e79889]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:05 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD Aug 24 10:09:05 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:05 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:06 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD Aug 24 10:09:06 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-addb874c-f858-4421-9a8b-06ba090d0bea-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-addb874c-f858-4421-9a8b-06ba090d0bea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6bf4ac-383a-4061-87b5-866af8ac85ff]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:06 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:06 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef757b6-bd12-40bf-b9c7-bc41b4a8664f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58499f4c01da46119e9529478839138c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:04Z,use_quota=True,user_id='7b3f0cceed3a4b77b940d68138a0247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Creating volume 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:06 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:06 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f 1073741824 Aug 24 10:09:06 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:06 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:06 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea Aug 24 10:09:06 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:07 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f 1073741824" returned: 0 in 0.547s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:07 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-addb874c-f858-4421-9a8b-06ba090d0bea" returned: 0 in 0.340s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:07 devstack sudo[109902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f Aug 24 10:09:07 devstack sudo[109902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-quobyte-addb874c-f858-4421-9a8b-06ba090d0bea" released by "delete_volume" :: held 0.854s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Created reservations ['e7eaae11-45ba-42ee-b7ce-c08ebd194016', 'f760ba67-ea26-4c8e-9eaa-a9dafe0b34d5', '362a3fb1-a099-43ad-a257-029e47866892', '13bee28d-2d81-42ca-9c27-5d61c43aed85'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:07 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:09:07 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:07 devstack sudo[109902]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" returned: 0 in 0.354s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Attempting download of 0fad15c8-3629-4fd1-94b5-f014160c8d25 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fad15c8-3629-4fd1-94b5-f014160c8d25', 'metadata': {}}])) to volume 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf83475-3c5e-4ad3-853c-4b4e064ca88d]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:07 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:09:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Deleted volume successfully. Aug 24 10:09:07 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm Aug 24 10:09:07 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-bf91c0c1-4fec-4508-8886-1fd7af94fc7e tempest-VolumesSnapshotListTestJSON-700637514 None] Lock "cinder-addb874c-f858-4421-9a8b-06ba090d0bea-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:08 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm" returned: 0 in 0.457s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:08 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm Aug 24 10:09:08 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:08 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm" returned: 1 in 0.461s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0fad15c8-3629-4fd1-94b5-f014160c8d25_5j81ayhm' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923b39c-d2e8-4405-b6e1-0f055725ea4d]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:08 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD Aug 24 10:09:08 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:08 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:09 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD Aug 24 10:09:09 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:09 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] 0fad15c8-3629-4fd1-94b5-f014160c8d25 was raw, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:09 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f Aug 24 10:09:09 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:09 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" returned: 0 in 0.594s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0fad15c8-3629-4fd1-94b5-f014160c8d25_8zdw1jiidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:09:09 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Converted 0.00 MB image at 0.00 MB/s Aug 24 10:09:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:09 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f 1G Aug 24 10:09:09 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:10 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f 1G" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Downloaded image 0fad15c8-3629-4fd1-94b5-f014160c8d25 ((None, [{'url': 'file:///opt/stack/data/glance/images/0fad15c8-3629-4fd1-94b5-f014160c8d25', 'metadata': {}}])) to volume 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Temporary image 0fad15c8-3629-4fd1-94b5-f014160c8d25 for user 7b3f0cceed3a4b77b940d68138a0247c is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Marking volume 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Copying metadata from image 0fad15c8-3629-4fd1-94b5-f014160c8d25 to 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Creating volume glance metadata for volume 1ef757b6-bd12-40bf-b9c7-bc41b4a8664f backed by image 0fad15c8-3629-4fd1-94b5-f014160c8d25 with: {'image_id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f6df49b717f69e65d49e54423b580588', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7e092c-da41-4d0d-b5c4-45c3031e27e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f', 'volume_size': 1, 'image_id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0fad15c8-3629-4fd1-94b5-f014160c8d25', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f6df49b717f69e65d49e54423b580588', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58499f4c01da46119e9529478839138c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20e17e898757192151ed22254905f5bbea4816b14d7c3c045577a6d56d29abba9e2f1403b9f0d7f9ea071f40c9a343f3815f6ba07936922c641bf340f30e7487', 'id': '0fad15c8-3629-4fd1-94b5-f014160c8d25', 'created_at': datetime.datetime(2026, 8, 24, 8, 9, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0fad15c8-3629-4fd1-94b5-f014160c8d25/file', 'properties': {}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43486552-0a48-4fb9-b0ba-4740ff1f767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Volume volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f (1ef757b6-bd12-40bf-b9c7-bc41b4a8664f): created successfully Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43486552-0a48-4fb9-b0ba-4740ff1f767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Flow 'volume_create_manager' (b1f8d8b0-e6a2-4b34-9873-40c591f1c667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5c37da1b-a03d-49a4-9144-e1cf6a323b90 tempest-VolumeImageDependencyTests-750268353 None] Created volume successfully. Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Acquiring lock "cinder-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Lock "cinder-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Acquiring lock "cinder-quobyte-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Lock "cinder-quobyte-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" acquired by "delete_volume" :: waited 0.058s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:11 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f9331d-5ca4-4342-8e4f-aaf0014ebb8b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:11 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f Aug 24 10:09:11 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:11 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" returned: 0 in 0.626s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:11 devstack sudo[110014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f Aug 24 10:09:11 devstack sudo[110014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:12 devstack sudo[110014]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" returned: 0 in 0.367s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Lock "cinder-quobyte-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f" released by "delete_volume" :: held 1.075s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Created reservations ['02e8c5fb-9d8f-4914-89f5-d27bf349c584', 'fba5b66d-02e5-4752-a823-a68533e7aa33', 'a0710af2-569e-4753-b169-5cb096e559a8', '31d08f16-5b08-4f1c-8e8b-1fa3c50769d2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:12 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:09:12 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:12 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.328s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:09:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Deleted volume successfully. Aug 24 10:09:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2fddc750-3b5f-40b0-ae07-17e25bba36bb tempest-VolumeImageDependencyTests-750268353 None] Lock "cinder-1ef757b6-bd12-40bf-b9c7-bc41b4a8664f-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Flow 'volume_create_manager' (c2c03aa2-3a5e-43a5-b51a-9dd9f226dcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57a3089-6dc7-4b0f-a5eb-8c153c246fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57a3089-6dc7-4b0f-a5eb-8c153c246fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1099291481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6169c7-d348-456e-8708-cab39d5e1f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425dd41020dc4527bbbcbefb3cd10827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:19Z,use_quota=True,user_id='c3894d884e4c4d5b8e1caa22033e03e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64380c06-9573-4b73-94c0-b6aa32e9c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64380c06-9573-4b73-94c0-b6aa32e9c652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6793a8-6460-4e91-9cfa-a47bea1d3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6793a8-6460-4e91-9cfa-a47bea1d3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6169c7-d348-456e-8708-cab39d5e1f56', 'volume_name': 'volume-4b6169c7-d348-456e-8708-cab39d5e1f56', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17c4c3a-b739-4882-8f6b-54f4a7f147ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17c4c3a-b739-4882-8f6b-54f4a7f147ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbf18a6-f8cc-4783-9656-218b8659b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Volume 4b6169c7-d348-456e-8708-cab39d5e1f56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6169c7-d348-456e-8708-cab39d5e1f56', 'volume_size': 1} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1099291481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6169c7-d348-456e-8708-cab39d5e1f56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425dd41020dc4527bbbcbefb3cd10827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:19Z,use_quota=True,user_id='c3894d884e4c4d5b8e1caa22033e03e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Creating volume 4b6169c7-d348-456e-8708-cab39d5e1f56 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:19 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:19 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 1073741824 Aug 24 10:09:19 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:20 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 1073741824" returned: 0 in 0.730s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:20 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 Aug 24 10:09:20 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:20 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56" returned: 0 in 0.486s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbbf18a6-f8cc-4783-9656-218b8659b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6169c7-d348-456e-8708-cab39d5e1f56', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4349e8a8-bc16-45f2-84ce-64bad3fd7dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Volume volume-4b6169c7-d348-456e-8708-cab39d5e1f56 (4b6169c7-d348-456e-8708-cab39d5e1f56): created successfully Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4349e8a8-bc16-45f2-84ce-64bad3fd7dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Flow 'volume_create_manager' (c2c03aa2-3a5e-43a5-b51a-9dd9f226dcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-76951d8d-7480-4074-996d-861772312aa3 tempest-ProjectReaderTests-1267612992 None] Created volume successfully. Aug 24 10:09:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "cinder-4b6169c7-d348-456e-8708-cab39d5e1f56-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-4b6169c7-d348-456e-8708-cab39d5e1f56-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "cinder-quobyte-4b6169c7-d348-456e-8708-cab39d5e1f56" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-quobyte-4b6169c7-d348-456e-8708-cab39d5e1f56" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94a5f9b-cd01-4d11-b69b-bc3df54cfcae]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:22 devstack sudo[110070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 Aug 24 10:09:22 devstack sudo[110070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:22 devstack sudo[110070]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56" returned: 0 in 0.458s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:22 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56 Aug 24 10:09:22 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:22 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b6169c7-d348-456e-8708-cab39d5e1f56" returned: 0 in 0.325s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-quobyte-4b6169c7-d348-456e-8708-cab39d5e1f56" released by "delete_volume" :: held 0.845s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Created reservations ['e38af225-ac8e-4103-b247-c053aa4e98e4', '6b55e267-5ec0-457f-b81f-4ed6b0b4ca25', 'bf8b2882-4b6a-4b9c-93c7-67ed3615036a', '14ce6407-61b9-4aea-9c09-104a0daf263b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:23 devstack sudo[110078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:09:23 devstack sudo[110078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:23 devstack sudo[110078]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.305s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:09:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Deleted volume successfully. Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8fca4ec6-fe61-4ac8-84dd-0ad66b5f0cf0 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-4b6169c7-d348-456e-8708-cab39d5e1f56-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Flow 'volume_create_manager' (fc1adef9-1e63-4f79-a955-84cc3e4d0225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7a788a-d221-4fa7-a462-0b66a0a9f751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c7a788a-d221-4fa7-a462-0b66a0a9f751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822409343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3edb2d1-aca2-48e0-b717-456f1a6a25de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425dd41020dc4527bbbcbefb3cd10827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:24Z,use_quota=True,user_id='c3894d884e4c4d5b8e1caa22033e03e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2661c971-5dba-471c-a647-a983f8737e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2661c971-5dba-471c-a647-a983f8737e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bfbcd2-9693-45d8-9f26-baf84a389b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bfbcd2-9693-45d8-9f26-baf84a389b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3edb2d1-aca2-48e0-b717-456f1a6a25de', 'volume_name': 'volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608bb8e7-bd19-4c1c-bc52-929a5c57a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608bb8e7-bd19-4c1c-bc52-929a5c57a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa0beda-bce8-43a8-a47e-8b259d64fbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Volume d3edb2d1-aca2-48e0-b717-456f1a6a25de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de', 'volume_size': 1} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822409343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3edb2d1-aca2-48e0-b717-456f1a6a25de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425dd41020dc4527bbbcbefb3cd10827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:24Z,use_quota=True,user_id='c3894d884e4c4d5b8e1caa22033e03e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Creating volume d3edb2d1-aca2-48e0-b717-456f1a6a25de {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:23 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:24 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de 1073741824 Aug 24 10:09:24 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:24 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de 1073741824" returned: 0 in 0.576s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:24 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de Aug 24 10:09:24 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:24 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa0beda-bce8-43a8-a47e-8b259d64fbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e3f8b4-58bb-4d57-b010-f83c1bb26290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Volume volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de (d3edb2d1-aca2-48e0-b717-456f1a6a25de): created successfully Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e3f8b4-58bb-4d57-b010-f83c1bb26290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Flow 'volume_create_manager' (fc1adef9-1e63-4f79-a955-84cc3e4d0225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d3a2b549-f5b4-4c42-a7d0-a20eefeab912 tempest-ProjectReaderTests-1267612992 None] Created volume successfully. Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "cinder-d3edb2d1-aca2-48e0-b717-456f1a6a25de-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-d3edb2d1-aca2-48e0-b717-456f1a6a25de-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:26 devstack sudo[110110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:09:26 devstack sudo[110110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "cinder-quobyte-d3edb2d1-aca2-48e0-b717-456f1a6a25de" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-quobyte-d3edb2d1-aca2-48e0-b717-456f1a6a25de" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc33176-49ef-4f5e-9c59-7e30aa72b37a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:26 devstack sudo[110112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de Aug 24 10:09:26 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:26 devstack sudo[110110]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:09:26 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de" returned: 0 in 0.429s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:26 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de Aug 24 10:09:26 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:27 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d3edb2d1-aca2-48e0-b717-456f1a6a25de" returned: 0 in 0.291s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-quobyte-d3edb2d1-aca2-48e0-b717-456f1a6a25de" released by "delete_volume" :: held 0.783s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Created reservations ['4898a33d-5f01-4916-ae30-a9180da6d253', 'ed8829d1-822e-40dc-b4d2-8b8bf7c2e3d7', 'f659f3a1-8eaf-4af0-ac5c-cf7a8ac41f47', 'a28e73ed-902a-4b2c-b9c9-bcd19f7cb6e9'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:27 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:09:27 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:27 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.281s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:09:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Deleted volume successfully. Aug 24 10:09:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9e02cd1a-54f7-4a8e-9893-e9068195ddd3 tempest-ProjectReaderTests-1267612992 None] Lock "cinder-d3edb2d1-aca2-48e0-b717-456f1a6a25de-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:09:37 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=66,cinder:INSERT=27,cinder:UPDATE=84,cinder:DELETE=4 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:09:37 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=65,cinder:UPDATE=76,cinder:DELETE=10,cinder:INSERT=21 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:09:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-86264370-10bf-43bb-b5c7-45ddca445ae3 req-c4906322-7ffb-44d1-8d0d-d40bbf07e20b tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-86264370-10bf-43bb-b5c7-45ddca445ae3 req-c4906322-7ffb-44d1-8d0d-d40bbf07e20b tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-86264370-10bf-43bb-b5c7-45ddca445ae3 req-c4906322-7ffb-44d1-8d0d-d40bbf07e20b tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:38 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-86264370-10bf-43bb-b5c7-45ddca445ae3 req-c4906322-7ffb-44d1-8d0d-d40bbf07e20b tempest-TestServerVolumeAttachmentScenario-2048157672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f401d9b2-2001-46a6-8d19-9ba71332935a', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:09:39 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-86264370-10bf-43bb-b5c7-45ddca445ae3 req-c4906322-7ffb-44d1-8d0d-d40bbf07e20b tempest-TestServerVolumeAttachmentScenario-2048157672 None] attachment_update completed successfully. Aug 24 10:09:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-78795e20-e024-48ca-92c6-9b2bada1cf96 req-29813ed7-3646-4dcf-b2e1-b457b5ce4078 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-78795e20-e024-48ca-92c6-9b2bada1cf96 req-29813ed7-3646-4dcf-b2e1-b457b5ce4078 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-78795e20-e024-48ca-92c6-9b2bada1cf96 req-29813ed7-3646-4dcf-b2e1-b457b5ce4078 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-78795e20-e024-48ca-92c6-9b2bada1cf96 req-29813ed7-3646-4dcf-b2e1-b457b5ce4078 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-63bac69e-b9c6-4516-b173-61db6ebd5301', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5751d3d2-1204-454d-a007-353ea7f090de', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:09:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-78795e20-e024-48ca-92c6-9b2bada1cf96 req-29813ed7-3646-4dcf-b2e1-b457b5ce4078 tempest-TestServerVolumeAttachmentScenario-2048157672 None] attachment_update completed successfully. Aug 24 10:09:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-958ae34c-a6b6-47c4-82ca-b62775bcd477 req-1ec64ccf-f6d4-4660-a642-c78a83c19e51 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Terminate volume connection completed successfully. Aug 24 10:09:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-958ae34c-a6b6-47c4-82ca-b62775bcd477 req-1ec64ccf-f6d4-4660-a642-c78a83c19e51 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Deleting attachment 5751d3d2-1204-454d-a007-353ea7f090de. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:09:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-c820e6b0-ad48-4c78-8307-04c854057876 req-ad74471c-2f3c-4d29-a8f7-b17be181ff89 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Terminate volume connection completed successfully. Aug 24 10:09:50 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-c820e6b0-ad48-4c78-8307-04c854057876 req-ad74471c-2f3c-4d29-a8f7-b17be181ff89 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Deleting attachment f401d9b2-2001-46a6-8d19-9ba71332935a. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:09:51 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Flow 'volume_create_manager' (9996a51e-40b4-4473-8ced-1966eeaee088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f7cb21-760d-416c-abdc-bb8683c6bab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f7cb21-760d-416c-abdc-bb8683c6bab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-724655078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a56edc5-32d5-449a-a45c-41cc6583d6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753b8020d6a54033a44e4489381a3292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:52Z,use_quota=True,user_id='508127923fe6454889dc698ecc5e78fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:51 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cf7a0e-4384-4f48-ba2e-075b73d541e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cf7a0e-4384-4f48-ba2e-075b73d541e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b35b558-23ce-4930-aaac-cb882c8cdca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b35b558-23ce-4930-aaac-cb882c8cdca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a56edc5-32d5-449a-a45c-41cc6583d6cb', 'volume_name': 'volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1fc7c1-1090-4e7a-aaf3-8471eb33f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1fc7c1-1090-4e7a-aaf3-8471eb33f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b09465e-c171-45ae-b557-617db76d3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:52 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Volume 9a56edc5-32d5-449a-a45c-41cc6583d6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb', 'volume_size': 1} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-724655078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a56edc5-32d5-449a-a45c-41cc6583d6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='753b8020d6a54033a44e4489381a3292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:52Z,use_quota=True,user_id='508127923fe6454889dc698ecc5e78fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Creating volume 9a56edc5-32d5-449a-a45c-41cc6583d6cb {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:52 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:52 devstack sudo[110759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb 1073741824 Aug 24 10:09:52 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:52 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb 1073741824" returned: 0 in 0.657s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:52 devstack sudo[110768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb Aug 24 10:09:52 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:53 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb" returned: 0 in 0.303s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b09465e-c171-45ae-b557-617db76d3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86ca835-c7a0-4b74-9b6a-1c006219ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:53 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Volume volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb (9a56edc5-32d5-449a-a45c-41cc6583d6cb): created successfully Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86ca835-c7a0-4b74-9b6a-1c006219ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Flow 'volume_create_manager' (9996a51e-40b4-4473-8ced-1966eeaee088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2bf5be53-5037-4d1d-9a4b-6da4337dc5af tempest-TestMinimumBasicScenario-35644523 None] Created volume successfully. Aug 24 10:09:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-18e57d5b-cc91-411d-b995-94fa5ea55731 req-7aad87b1-9337-4cc4-a475-9d2b79ec0f69 tempest-TestMinimumBasicScenario-35644523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-18e57d5b-cc91-411d-b995-94fa5ea55731 req-7aad87b1-9337-4cc4-a475-9d2b79ec0f69 tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-18e57d5b-cc91-411d-b995-94fa5ea55731 req-7aad87b1-9337-4cc4-a475-9d2b79ec0f69 tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-18e57d5b-cc91-411d-b995-94fa5ea55731 req-7aad87b1-9337-4cc4-a475-9d2b79ec0f69 tempest-TestMinimumBasicScenario-35644523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e06f6577-fd51-416c-991d-54afe98ec9b1', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:09:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-18e57d5b-cc91-411d-b995-94fa5ea55731 req-7aad87b1-9337-4cc4-a475-9d2b79ec0f69 tempest-TestMinimumBasicScenario-35644523 None] attachment_update completed successfully. Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Flow 'volume_create_manager' (b80d66cf-f2bf-4978-8674-26dade5028d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a22692-66f4-46a4-ab19-ed14450e8677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a22692-66f4-46a4-ab19-ed14450e8677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-964466317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118374e5-cf1c-497c-8168-a8123afaf268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f898cb4cd7420d8496c4fdf99b84df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:59Z,use_quota=True,user_id='796e8d101bb74750a64edb643c8dc7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a736cb27-d701-439b-bb52-f8632342710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a736cb27-d701-439b-bb52-f8632342710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e790c0-50e0-4427-b61f-43b8408142b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e790c0-50e0-4427-b61f-43b8408142b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118374e5-cf1c-497c-8168-a8123afaf268', 'volume_name': 'volume-118374e5-cf1c-497c-8168-a8123afaf268', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7119e31-9806-4163-b82a-a96135b8ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7119e31-9806-4163-b82a-a96135b8ea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9510ad-83f4-4c58-9385-eca6f3ba2d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:09:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Volume 118374e5-cf1c-497c-8168-a8123afaf268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118374e5-cf1c-497c-8168-a8123afaf268', 'volume_size': 1} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-964466317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118374e5-cf1c-497c-8168-a8123afaf268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f898cb4cd7420d8496c4fdf99b84df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:09:59Z,use_quota=True,user_id='796e8d101bb74750a64edb643c8dc7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Creating volume 118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:09:58 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:09:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:58 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 1073741824 Aug 24 10:09:58 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:09:59 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Aug 24 10:09:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 1073741824" returned: 0 in 0.850s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:09:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:09:59 devstack sudo[111178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 Aug 24 10:09:59 devstack sudo[111178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "cinder-63bac69e-b9c6-4516-b173-61db6ebd5301-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-63bac69e-b9c6-4516-b173-61db6ebd5301-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "cinder-quobyte-63bac69e-b9c6-4516-b173-61db6ebd5301" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:00 devstack sudo[111178]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268" returned: 0 in 0.517s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-quobyte-63bac69e-b9c6-4516-b173-61db6ebd5301" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9510ad-83f4-4c58-9385-eca6f3ba2d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118374e5-cf1c-497c-8168-a8123afaf268', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a232fb13-7cde-4b7f-b7de-eee9c87a1f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed8702-e7b4-4c46-ba1d-3d933d7ca6e0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:00 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Volume volume-118374e5-cf1c-497c-8168-a8123afaf268 (118374e5-cf1c-497c-8168-a8123afaf268): created successfully Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a232fb13-7cde-4b7f-b7de-eee9c87a1f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Flow 'volume_create_manager' (b80d66cf-f2bf-4978-8674-26dade5028d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:10:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a86db0ec-bcbc-4247-b5d0-c4d5e2489457 tempest-SnapshotDependencyTests-368664729 None] Created volume successfully. Aug 24 10:10:00 devstack sudo[111181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 Aug 24 10:10:00 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:00 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301" returned: 0 in 0.520s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:00 devstack sudo[111187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301 Aug 24 10:10:00 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Creating offline snapshot 2ad057a2-f592-46c7-92ca-7928958cc720 of volume 118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[305162f5-3efe-4cb6-af47-f755605ac3c3]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:01 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-63bac69e-b9c6-4516-b173-61db6ebd5301" returned: 0 in 0.354s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-quobyte-63bac69e-b9c6-4516-b173-61db6ebd5301" released by "delete_volume" :: held 0.937s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Created reservations ['e5b35da8-04df-4d38-a5ac-b1c6ca6a7c55', '785b42f6-1af5-4fb2-bba2-d5def00f996f', '1decf3db-6c0e-4f83-a0a7-02594aed86c4', 'cde1592e-b78b-4f8b-b48f-9a40c1a62d4e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:10:01 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 Aug 24 10:10:01 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:01 devstack sudo[111195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:10:01 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:01 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268" returned: 0 in 0.580s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:01 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 1G Aug 24 10:10:01 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:01 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.447s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:10:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Deleted volume successfully. Aug 24 10:10:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-69ffc055-d77b-4d5b-a1c3-039daa1b6cd5 tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-63bac69e-b9c6-4516-b173-61db6ebd5301-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:02 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 1G" returned: 0 in 0.543s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118374e5-cf1c-497c-8168-a8123afaf268 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:02 devstack sudo[111232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118374e5-cf1c-497c-8168-a8123afaf268 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 Aug 24 10:10:02 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "cinder-f3db0d31-e58a-44d5-9ff0-75130e5f8264-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-f3db0d31-e58a-44d5-9ff0-75130e5f8264-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "cinder-quobyte-f3db0d31-e58a-44d5-9ff0-75130e5f8264" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-quobyte-f3db0d31-e58a-44d5-9ff0-75130e5f8264" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd2915-fe1c-44b1-9762-3640516efb5a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:02 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118374e5-cf1c-497c-8168-a8123afaf268 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720" returned: 0 in 0.534s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:02 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 is being set with open permissions: ugo+rw Aug 24 10:10:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:02 devstack sudo[111236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 Aug 24 10:10:02 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:02 devstack sudo[111238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 Aug 24 10:10:02 devstack sudo[111238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:03 devstack sudo[111238]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720" returned: 0 in 0.391s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:03 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:03 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264 Aug 24 10:10:03 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:03 devstack sudo[111247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info Aug 24 10:10:03 devstack sudo[111247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:03 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f3db0d31-e58a-44d5-9ff0-75130e5f8264" returned: 0 in 0.316s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-quobyte-f3db0d31-e58a-44d5-9ff0-75130e5f8264" released by "delete_volume" :: held 0.897s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:03 devstack sudo[111247]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:03 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info is being set with open permissions: ugo+rw Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:03 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info Aug 24 10:10:03 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Created reservations ['57da2925-663e-4098-bc53-90f569c2061e', '99ca0dfa-135c-4793-acc4-fef7d46cee36', '88f0a6ab-31bf-4f59-b6f5-6ad33f456c64', '276af296-bb32-47be-9d27-df63fba097b5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:03 devstack sudo[111253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:10:03 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:03 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.info" returned: 0 in 0.280s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-bb4be029-c611-4cbb-ab92-d79e9245f74f tempest-SnapshotDependencyTests-368664729 None] Create snapshot completed successfully Aug 24 10:10:04 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.307s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:10:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Deleted volume successfully. Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67f72156-1bef-4a97-8726-67044113d4ed tempest-TestServerVolumeAttachmentScenario-2048157672 None] Lock "cinder-f3db0d31-e58a-44d5-9ff0-75130e5f8264-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Flow 'volume_create_manager' (42f03cec-4736-439a-a52a-3b7b3b7cbd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f390f89b-920c-4ee2-9dc6-3f31ff8f51fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f390f89b-920c-4ee2-9dc6-3f31ff8f51fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a1e872-3b55-4efd-92bf-5a152742ef8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f898cb4cd7420d8496c4fdf99b84df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ad057a2-f592-46c7-92ca-7928958cc720,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:10:05Z,use_quota=True,user_id='796e8d101bb74750a64edb643c8dc7dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a34889-90b9-443c-8fad-4f21167fcd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a34889-90b9-443c-8fad-4f21167fcd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a93d5b-d08b-44ee-8311-5e98ec28b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a93d5b-d08b-44ee-8311-5e98ec28b765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39a1e872-3b55-4efd-92bf-5a152742ef8a', 'volume_name': 'volume-39a1e872-3b55-4efd-92bf-5a152742ef8a', 'volume_size': 1, 'snapshot_id': '2ad057a2-f592-46c7-92ca-7928958cc720'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80181b9b-d741-45a5-a686-67db6cacaa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80181b9b-d741-45a5-a686-67db6cacaa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b47122-0b60-4a22-9918-b0a1726903c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Volume 39a1e872-3b55-4efd-92bf-5a152742ef8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39a1e872-3b55-4efd-92bf-5a152742ef8a', 'volume_size': 1, 'snapshot_id': '2ad057a2-f592-46c7-92ca-7928958cc720'} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-quobyte-2ad057a2-f592-46c7-92ca-7928958cc720-39a1e872-3b55-4efd-92bf-5a152742ef8a" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-2ad057a2-f592-46c7-92ca-7928958cc720-39a1e872-3b55-4efd-92bf-5a152742ef8a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Creating volume 39a1e872-3b55-4efd-92bf-5a152742ef8a from snapshot 2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-quobyte-39a1e872-3b55-4efd-92bf-5a152742ef8a" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-39a1e872-3b55-4efd-92bf-5a152742ef8a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] snapshot: 2ad057a2-f592-46c7-92ca-7928958cc720, volume: 39a1e872-3b55-4efd-92bf-5a152742ef8a, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e54843-980e-4e53-a349-993148a16bb8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:05 devstack sudo[111257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 Aug 24 10:10:05 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:05 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-118374e5-cf1c-497c-8168-a8123afaf268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[49846e81-bcb0-4c1f-acb0-b7364b42adf5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:05 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 Aug 24 10:10:05 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:06 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268" returned: 0 in 0.477s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:10:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:10:06 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:10:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:06 devstack sudo[111268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a Aug 24 10:10:06 devstack sudo[111268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:11 devstack sudo[111268]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a" returned: 0 in 5.024s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:10:11 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Converted 1024.00 MB image at 203.75 MB/s Aug 24 10:10:11 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a is being set with open permissions: ugo+rw Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:11 devstack sudo[111283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a Aug 24 10:10:11 devstack sudo[111283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:11 devstack sudo[111283]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a" returned: 0 in 0.311s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-39a1e872-3b55-4efd-92bf-5a152742ef8a" released by "_copy_volume_from_snapshot" :: held 6.357s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-2ad057a2-f592-46c7-92ca-7928958cc720-39a1e872-3b55-4efd-92bf-5a152742ef8a" released by "_create_volume_from_snapshot" :: held 6.431s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.448s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b47122-0b60-4a22-9918-b0a1726903c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a1e872-3b55-4efd-92bf-5a152742ef8a', 'volume_size': 1, 'snapshot_id': '2ad057a2-f592-46c7-92ca-7928958cc720'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6831bca1-2053-4cfa-907b-5a6016e88e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Volume volume-39a1e872-3b55-4efd-92bf-5a152742ef8a (39a1e872-3b55-4efd-92bf-5a152742ef8a): created successfully Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6831bca1-2053-4cfa-907b-5a6016e88e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Flow 'volume_create_manager' (42f03cec-4736-439a-a52a-3b7b3b7cbd1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:10:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-39e4ca8e-42a1-4b2a-b8cd-16df4885814f tempest-SnapshotDependencyTests-368664729 None] Created volume successfully. Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-2ad057a2-f592-46c7-92ca-7928958cc720-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-2ad057a2-f592-46c7-92ca-7928958cc720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-quobyte-118374e5-cf1c-497c-8168-a8123afaf268" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-118374e5-cf1c-497c-8168-a8123afaf268" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-quobyte-2ad057a2-f592-46c7-92ca-7928958cc720" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-2ad057a2-f592-46c7-92ca-7928958cc720" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Deleting offline snapshot 2ad057a2-f592-46c7-92ca-7928958cc720 of volume 118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] snapshot_file for this snap is: volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3724f2b2-3c76-4224-a03b-1f33740ee15b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:11 devstack sudo[111286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 Aug 24 10:10:11 devstack sudo[111286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:12 devstack sudo[111286]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720" returned: 0 in 0.511s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-118374e5-cf1c-497c-8168-a8123afaf268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:10:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ca020f-4070-4628-9586-b60dd3bf5ca1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:12 devstack sudo[111291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 Aug 24 10:10:12 devstack sudo[111291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:13 devstack sudo[111291]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268" returned: 0 in 0.654s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:13 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 Aug 24 10:10:13 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:13 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720" returned: 0 in 0.463s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:13 devstack sudo[111305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720 Aug 24 10:10:13 devstack sudo[111305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:13 devstack sudo[111305]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268.2ad057a2-f592-46c7-92ca-7928958cc720" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-2ad057a2-f592-46c7-92ca-7928958cc720" released by "_delete_snapshot" :: held 2.055s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-118374e5-cf1c-497c-8168-a8123afaf268" released by "delete_snapshot" :: held 2.085s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:13 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Created reservations ['5223bd22-c3d6-4c85-8743-e394867e5156', 'be12e704-e647-4d10-80ac-be4259e94855', 'be394dd4-d18d-4b81-99b5-cc9e0a9cd9f1', '0aee57c4-a251-4391-a024-afded1e4f9b2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:10:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Delete snapshot completed successfully. Aug 24 10:10:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5ab305f8-3d35-4940-85ca-eced2ae1ce99 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-2ad057a2-f592-46c7-92ca-7928958cc720-delete_snapshot" released by "delete_snapshot" :: held 2.277s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-118374e5-cf1c-497c-8168-a8123afaf268-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-118374e5-cf1c-497c-8168-a8123afaf268-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-quobyte-118374e5-cf1c-497c-8168-a8123afaf268" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-118374e5-cf1c-497c-8168-a8123afaf268" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0117992-eee6-4c32-975f-31bcaa4ff477]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:15 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 Aug 24 10:10:15 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:15 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268" returned: 0 in 0.368s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:15 devstack sudo[111314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268 Aug 24 10:10:15 devstack sudo[111314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:15 devstack sudo[111314]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-118374e5-cf1c-497c-8168-a8123afaf268" returned: 0 in 0.332s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-118374e5-cf1c-497c-8168-a8123afaf268" released by "delete_volume" :: held 0.772s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:15 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Created reservations ['1e1a4983-9353-4b10-be86-197106e4e8be', 'dbd13347-bdcb-4254-8732-2a6ee56f3864', 'f02c7d1e-55a1-44eb-9928-7e9b9765cb8f', 'e46d2c0c-8919-4765-9819-0b0d72a8ec97'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:16 devstack sudo[111317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:10:16 devstack sudo[111317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-39a1e872-3b55-4efd-92bf-5a152742ef8a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-39a1e872-3b55-4efd-92bf-5a152742ef8a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "cinder-quobyte-39a1e872-3b55-4efd-92bf-5a152742ef8a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-39a1e872-3b55-4efd-92bf-5a152742ef8a" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda1721b-4cf8-48aa-9f42-17314ad985c7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:16 devstack sudo[111317]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.343s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:10:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Deleted volume successfully. Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5faecaf6-36bb-42b2-b3c9-b6f42588ef86 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-118374e5-cf1c-497c-8168-a8123afaf268-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:16 devstack sudo[111345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a Aug 24 10:10:16 devstack sudo[111345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:16 devstack sudo[111345]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a" returned: 0 in 0.380s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:16 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a Aug 24 10:10:16 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:17 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-39a1e872-3b55-4efd-92bf-5a152742ef8a" returned: 0 in 0.264s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-quobyte-39a1e872-3b55-4efd-92bf-5a152742ef8a" released by "delete_volume" :: held 0.698s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Created reservations ['ba96bb9b-1395-480e-a644-a3927c8cac85', 'f5632bf6-1989-4695-a098-29f7535b8861', '907cf5a4-d1f4-4eb1-a74b-5fb8139d78bb', 'e3b612b8-c55c-4870-8001-5e34906ddde2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:17 devstack sudo[111364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:10:17 devstack sudo[111364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:17 devstack sudo[111364]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.342s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:10:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Deleted volume successfully. Aug 24 10:10:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-93c1a339-f21e-4226-bfaf-4062343b6166 tempest-SnapshotDependencyTests-368664729 None] Lock "cinder-39a1e872-3b55-4efd-92bf-5a152742ef8a-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:26 devstack sudo[111415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:10:26 devstack sudo[111415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:26 devstack sudo[111415]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.287s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:10:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:10:27 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=61,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=8 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:10:27 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=55,cinder:UPDATE=55,cinder:INSERT=16,cinder:DELETE=3 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:10:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-64129fb0-0e82-4e30-b0d0-8f6f4eb41e50 req-4399b666-afc2-4f4a-96e6-0b4f73c1264d tempest-TestMinimumBasicScenario-35644523 None] Terminate volume connection completed successfully. Aug 24 10:10:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-64129fb0-0e82-4e30-b0d0-8f6f4eb41e50 req-4399b666-afc2-4f4a-96e6-0b4f73c1264d tempest-TestMinimumBasicScenario-35644523 None] Deleting attachment e06f6577-fd51-416c-991d-54afe98ec9b1. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Acquiring lock "cinder-9a56edc5-32d5-449a-a45c-41cc6583d6cb-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Lock "cinder-9a56edc5-32d5-449a-a45c-41cc6583d6cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Acquiring lock "cinder-quobyte-9a56edc5-32d5-449a-a45c-41cc6583d6cb" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Lock "cinder-quobyte-9a56edc5-32d5-449a-a45c-41cc6583d6cb" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5edd6-739f-40a3-9533-9427d33f65e1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:47 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb Aug 24 10:10:47 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:47 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:47 devstack sudo[111496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb Aug 24 10:10:47 devstack sudo[111496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:47 devstack sudo[111496]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a56edc5-32d5-449a-a45c-41cc6583d6cb" returned: 0 in 0.274s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Lock "cinder-quobyte-9a56edc5-32d5-449a-a45c-41cc6583d6cb" released by "delete_volume" :: held 0.716s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Created reservations ['bbfd2469-30c3-4cd6-9445-4614b11665bb', '0c55c8c3-9bc0-4ddf-817a-84002e9df309', '9b1499d3-1285-4df8-a242-f9ca1e32c926', 'ad631829-9eeb-44c5-9b0c-6fa17a9e6712'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:48 devstack sudo[111499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:10:48 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:48 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.260s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:10:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Deleted volume successfully. Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8883bd11-1c9f-4783-925f-2dd3aec9ea1f tempest-TestMinimumBasicScenario-35644523 None] Lock "cinder-9a56edc5-32d5-449a-a45c-41cc6583d6cb-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Flow 'volume_create_manager' (14879fe8-b6de-4e70-9378-80089e290214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d868492d-0d5b-4478-973c-5b378b2ddd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d868492d-0d5b-4478-973c-5b378b2ddd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-37948573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84774584-dda0-48c4-859f-78ff23bc3540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8314f057d9664622974f3a7f79514423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:10:48Z,use_quota=True,user_id='89b3df1567b542a7b595a477dc4701fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb597b9-51e7-47e1-bc0a-a3325af62086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb597b9-51e7-47e1-bc0a-a3325af62086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c284dff3-5344-4fa3-815c-aaa4db86746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c284dff3-5344-4fa3-815c-aaa4db86746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84774584-dda0-48c4-859f-78ff23bc3540', 'volume_name': 'volume-84774584-dda0-48c4-859f-78ff23bc3540', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603eff18-4420-4fff-93b7-e7deb9f2c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603eff18-4420-4fff-93b7-e7deb9f2c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2942a9f-12e6-45d9-a3bf-f8693919c42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:48 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Volume 84774584-dda0-48c4-859f-78ff23bc3540: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84774584-dda0-48c4-859f-78ff23bc3540', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 24 10:10:48 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Trying to clone 84774584-dda0-48c4-859f-78ff23bc3540 from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:10:49 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:10:49 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Image download 20.69 MB at 20.69 MB/s Aug 24 10:10:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac95681d-8109-401d-93ee-d762625eaf56]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:49 devstack sudo[111526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD Aug 24 10:10:49 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:49 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:49 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 is fetched for user 89b3df1567b542a7b595a477dc4701fa. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e75964-d21f-4a5e-a883-244baf649263]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:50 devstack sudo[111533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD Aug 24 10:10:50 devstack sudo[111533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:50 devstack sudo[111533]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-37948573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84774584-dda0-48c4-859f-78ff23bc3540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8314f057d9664622974f3a7f79514423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:10:48Z,use_quota=True,user_id='89b3df1567b542a7b595a477dc4701fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Creating volume 84774584-dda0-48c4-859f-78ff23bc3540 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:10:50 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:50 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 1073741824 Aug 24 10:10:50 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:50 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 1073741824" returned: 0 in 0.408s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:50 devstack sudo[111543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 Aug 24 10:10:50 devstack sudo[111543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:51 devstack sudo[111543]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540" returned: 0 in 0.245s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Attempting download of 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 84774584-dda0-48c4-859f-78ff23bc3540. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[93443acd-fd46-4ed9-93bd-8ca7cec7028f]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:51 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s Aug 24 10:10:51 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:51 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s" returned: 0 in 0.328s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:51 devstack sudo[111551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s Aug 24 10:10:51 devstack sudo[111551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:51 devstack sudo[111551]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s" returned: 1 in 0.335s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_75b0df00-ae63-45cf-a244-f0a90610f6d1_axe10z6s' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c551822c-c7be-4fa9-b086-7e1922e2aa3e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:10:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:52 devstack sudo[111555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD Aug 24 10:10:52 devstack sudo[111555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:52 devstack sudo[111555]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:52 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] 75b0df00-ae63-45cf-a244-f0a90610f6d1 was qcow2, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:10:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:52 devstack sudo[111560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 Aug 24 10:10:52 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:53 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540" returned: 0 in 1.715s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:53 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_75b0df00-ae63-45cf-a244-f0a90610f6d1_5qfd9wm0devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:10:53 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Converted 112.00 MB image at 65.25 MB/s Aug 24 10:10:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:10:53 devstack sudo[111569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 1G Aug 24 10:10:53 devstack sudo[111569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:10:54 devstack sudo[111569]: pam_unix(sudo:session): session closed for user root Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 1G" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Downloaded image 75b0df00-ae63-45cf-a244-f0a90610f6d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}])) to volume 84774584-dda0-48c4-859f-78ff23bc3540 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Temporary image 75b0df00-ae63-45cf-a244-f0a90610f6d1 for user 89b3df1567b542a7b595a477dc4701fa is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Marking volume 84774584-dda0-48c4-859f-78ff23bc3540 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Copying metadata from image 75b0df00-ae63-45cf-a244-f0a90610f6d1 to 84774584-dda0-48c4-859f-78ff23bc3540. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Creating volume glance metadata for volume 84774584-dda0-48c4-859f-78ff23bc3540 backed by image 75b0df00-ae63-45cf-a244-f0a90610f6d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2942a9f-12e6-45d9-a3bf-f8693919c42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84774584-dda0-48c4-859f-78ff23bc3540', 'volume_size': 1, 'image_id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/75b0df00-ae63-45cf-a244-f0a90610f6d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2bf1cda7add246cab6b2189bb892b7c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '75b0df00-ae63-45cf-a244-f0a90610f6d1', 'created_at': datetime.datetime(2026, 8, 24, 7, 48, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 7, 48, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/75b0df00-ae63-45cf-a244-f0a90610f6d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122794b8-187e-4764-b13d-441e5ba9fb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:10:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Volume volume-84774584-dda0-48c4-859f-78ff23bc3540 (84774584-dda0-48c4-859f-78ff23bc3540): created successfully Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122794b8-187e-4764-b13d-441e5ba9fb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:10:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Flow 'volume_create_manager' (14879fe8-b6de-4e70-9378-80089e290214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:10:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b3382ac2-d5f2-4d7b-93f4-bf2861ec6a21 tempest-TestShelveInstance-1865760990 None] Created volume successfully. Aug 24 10:10:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-5dd01d3a-92e0-459d-a3d2-ef6193a742b0 req-172cf3d1-6c2a-413e-a192-c2a7fca091c9 tempest-TestShelveInstance-1865760990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:10:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-5dd01d3a-92e0-459d-a3d2-ef6193a742b0 req-172cf3d1-6c2a-413e-a192-c2a7fca091c9 tempest-TestShelveInstance-1865760990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:10:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-5dd01d3a-92e0-459d-a3d2-ef6193a742b0 req-172cf3d1-6c2a-413e-a192-c2a7fca091c9 tempest-TestShelveInstance-1865760990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:10:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-5dd01d3a-92e0-459d-a3d2-ef6193a742b0 req-172cf3d1-6c2a-413e-a192-c2a7fca091c9 tempest-TestShelveInstance-1865760990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-84774584-dda0-48c4-859f-78ff23bc3540', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd79d4d3-3e70-4cdb-88df-28f8ccf0d78a', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:10:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-5dd01d3a-92e0-459d-a3d2-ef6193a742b0 req-172cf3d1-6c2a-413e-a192-c2a7fca091c9 tempest-TestShelveInstance-1865760990 None] attachment_update completed successfully. Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (8e19f27a-b063-4e00-bfe7-728c89042469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc29e6c2-b663-4e9a-b153-18fbd8c191dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc29e6c2-b663-4e9a-b153-18fbd8c191dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-508536266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a13c4-286f-4991-ae95-037060f56c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:04Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bd552f-9b14-4ccb-ac6e-661eba34fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bd552f-9b14-4ccb-ac6e-661eba34fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca0a45a-d9dc-4606-ad3d-a2cfa66a454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca0a45a-d9dc-4606-ad3d-a2cfa66a454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376a13c4-286f-4991-ae95-037060f56c79', 'volume_name': 'volume-376a13c4-286f-4991-ae95-037060f56c79', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513004e0-836c-4ecb-9ba6-0109b32dd0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513004e0-836c-4ecb-9ba6-0109b32dd0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5ec85a-bf73-4521-8210-8c2d07b106ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:04 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Volume 376a13c4-286f-4991-ae95-037060f56c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376a13c4-286f-4991-ae95-037060f56c79', 'volume_size': 1} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-508536266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376a13c4-286f-4991-ae95-037060f56c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:04Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Creating volume 376a13c4-286f-4991-ae95-037060f56c79 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:04 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:11:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:04 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 1073741824 Aug 24 10:11:04 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (e9af07ea-c815-420b-9782-ceb2cea79459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19365212-1196-457d-ab8b-f80d2a752701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19365212-1196-457d-ab8b-f80d2a752701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439350172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:05Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f2eddd-bfbe-48f9-8eb4-a2c7a9e53c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f2eddd-bfbe-48f9-8eb4-a2c7a9e53c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b63c5d-e761-436a-b28d-4dae190eb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b63c5d-e761-436a-b28d-4dae190eb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea', 'volume_name': 'volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0823dc-6ac7-4880-bd59-6cbcbb58241e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0823dc-6ac7-4880-bd59-6cbcbb58241e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22764da-b5a5-4d37-a389-8230dfb4081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Volume 10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea', 'volume_size': 1} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:05 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 1073741824" returned: 0 in 0.859s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:05 devstack sudo[112061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 Aug 24 10:11:05 devstack sudo[112061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (75614017-0d7d-4bb2-9d63-9133aac7b466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eecaa32-efa2-44a0-9e30-f85dc596ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eecaa32-efa2-44a0-9e30-f85dc596ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1592930194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b42bc60-05f8-4830-929f-3224ec0cef4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:06Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83212a7-a7fa-4874-b9b2-a74b1323baac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83212a7-a7fa-4874-b9b2-a74b1323baac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1ef03f-837c-419c-b129-b46125bd2dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd1ef03f-837c-419c-b129-b46125bd2dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b42bc60-05f8-4830-929f-3224ec0cef4c', 'volume_name': 'volume-9b42bc60-05f8-4830-929f-3224ec0cef4c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909c1daa-acdb-4c05-8c45-47926f36c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (909c1daa-acdb-4c05-8c45-47926f36c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b87cf2-7a5f-40c1-b8a4-ee1ed937e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Volume 9b42bc60-05f8-4830-929f-3224ec0cef4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b42bc60-05f8-4830-929f-3224ec0cef4c', 'volume_size': 1} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:05 devstack sudo[112061]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79" returned: 0 in 0.405s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439350172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:05Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Creating volume 10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5ec85a-bf73-4521-8210-8c2d07b106ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376a13c4-286f-4991-ae95-037060f56c79', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d15c84-2ba4-4d55-a1fd-d8ea014a43d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack sudo[112064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea 1073741824 Aug 24 10:11:06 devstack sudo[112064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Volume volume-376a13c4-286f-4991-ae95-037060f56c79 (376a13c4-286f-4991-ae95-037060f56c79): created successfully Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d15c84-2ba4-4d55-a1fd-d8ea014a43d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (8e19f27a-b063-4e00-bfe7-728c89042469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2edb6242-09dc-4d81-a9a8-a3c66de76a69 tempest-CreateVolumesFromImageTest-1556983751 None] Created volume successfully. Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (35fc3f3f-5e60-426a-b45e-2220978e9d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68901d55-ddce-47b8-adb6-2bd173824347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68901d55-ddce-47b8-adb6-2bd173824347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1214743547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f548ff-19fe-4b4a-95b1-484e22c01d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:06Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa27e65-b78d-4d14-ad64-901cf8e34bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa27e65-b78d-4d14-ad64-901cf8e34bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974d09b6-87eb-494e-9735-af9684653825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974d09b6-87eb-494e-9735-af9684653825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f548ff-19fe-4b4a-95b1-484e22c01d5a', 'volume_name': 'volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6560ed7c-ac91-4164-9923-e0065afe2783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6560ed7c-ac91-4164-9923-e0065afe2783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988b6f7a-2369-499e-9656-4d87d8b27509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Volume e3f548ff-19fe-4b4a-95b1-484e22c01d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a', 'volume_size': 1} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:06 devstack sudo[112064]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea 1073741824" returned: 0 in 0.871s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (1c514b47-50d8-47a8-84f0-58a86a187462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3689c0-9e66-464e-99c1-7a3883558ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:06 devstack sudo[112069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea Aug 24 10:11:06 devstack sudo[112069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3689c0-9e66-464e-99c1-7a3883558ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424332697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:07Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d10505-c031-4cfb-ad01-48624c5eab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d10505-c031-4cfb-ad01-48624c5eab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72b6635-2625-43e3-841f-b9ead2ca3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72b6635-2625-43e3-841f-b9ead2ca3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8', 'volume_name': 'volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2c454-6a1b-41e5-b88e-d8f6046a610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d2c454-6a1b-41e5-b88e-d8f6046a610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518b51ba-a51b-4562-8b79-a6d42a6be7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Volume ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8', 'volume_size': 1} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:07 devstack sudo[112069]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea" returned: 0 in 0.293s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1592930194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b42bc60-05f8-4830-929f-3224ec0cef4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:06Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Creating volume 9b42bc60-05f8-4830-929f-3224ec0cef4c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:07 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22764da-b5a5-4d37-a389-8230dfb4081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a058bee2-a20c-4d0d-ab09-b8fd49355ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:07 devstack sudo[112072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c 1073741824 Aug 24 10:11:07 devstack sudo[112072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Volume volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea (10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea): created successfully Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a058bee2-a20c-4d0d-ab09-b8fd49355ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (e9af07ea-c815-420b-9782-ceb2cea79459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-778642f4-3832-47da-9f4e-90c03dd102ad tempest-CreateVolumesFromImageTest-1556983751 None] Created volume successfully. Aug 24 10:11:07 devstack sudo[112072]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c 1073741824" returned: 0 in 0.621s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:08 devstack sudo[112079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c Aug 24 10:11:08 devstack sudo[112079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:08 devstack sudo[112079]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c" returned: 0 in 0.390s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1214743547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f548ff-19fe-4b4a-95b1-484e22c01d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:06Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Creating volume e3f548ff-19fe-4b4a-95b1-484e22c01d5a {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:08 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b87cf2-7a5f-40c1-b8a4-ee1ed937e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b42bc60-05f8-4830-929f-3224ec0cef4c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:08 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a 1073741824 Aug 24 10:11:08 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8898d884-9209-4fba-b278-64b7fecf121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:08 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Volume volume-9b42bc60-05f8-4830-929f-3224ec0cef4c (9b42bc60-05f8-4830-929f-3224ec0cef4c): created successfully Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8898d884-9209-4fba-b278-64b7fecf121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (75614017-0d7d-4bb2-9d63-9133aac7b466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ad950df0-a62e-42ee-81c5-f36e89ae5499 tempest-CreateVolumesFromImageTest-1556983751 None] Created volume successfully. Aug 24 10:11:08 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a 1073741824" returned: 0 in 0.531s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:08 devstack sudo[112089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a Aug 24 10:11:08 devstack sudo[112089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:09 devstack sudo[112089]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.177s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-424332697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fa39184d2649ddb842b557fcb0435c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:07Z,use_quota=True,user_id='7abcb9d792964d83979eeab786f66aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Creating volume ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:09 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988b6f7a-2369-499e-9656-4d87d8b27509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:09 devstack sudo[112092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 1073741824 Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051fadac-cae0-46ee-ba69-92c225a063e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:09 devstack sudo[112092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:09 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Volume volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a (e3f548ff-19fe-4b4a-95b1-484e22c01d5a): created successfully Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051fadac-cae0-46ee-ba69-92c225a063e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (35fc3f3f-5e60-426a-b45e-2220978e9d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5bc865c7-4de9-4d6f-b393-0d72d45d88ed tempest-CreateVolumesFromImageTest-1556983751 None] Created volume successfully. Aug 24 10:11:09 devstack sudo[112092]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 1073741824" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:09 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 Aug 24 10:11:09 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:09 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8" returned: 0 in 0.255s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518b51ba-a51b-4562-8b79-a6d42a6be7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26a3e93-f622-496d-b8d6-3745e345e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Volume volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 (ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8): created successfully Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26a3e93-f622-496d-b8d6-3745e345e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Flow 'volume_create_manager' (1c514b47-50d8-47a8-84f0-58a86a187462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-70a51e07-e5aa-496f-86f1-d857566b2b75 tempest-CreateVolumesFromImageTest-1556983751 None] Created volume successfully. Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-quobyte-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e57d96-bb86-4fcf-812c-d3bfb6d742c7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:10 devstack sudo[112100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 Aug 24 10:11:10 devstack sudo[112100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:11 devstack sudo[112100]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8" returned: 0 in 0.366s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:11 devstack sudo[112106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8 Aug 24 10:11:11 devstack sudo[112106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:11 devstack sudo[112106]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8" released by "delete_volume" :: held 0.669s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Created reservations ['d3e83e2c-e28e-497c-a037-223f8389aad3', 'bc01ae5b-8b52-4dba-a470-d04c2609b62b', 'b918ecd4-0ede-47f1-914f-11350f3d950a', 'd9efae0f-10f5-46d9-80fa-441676d9197f'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:11 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:11 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:11 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Deleted volume successfully. Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fa4d12cb-ced2-433c-9bee-3ba7ec5a0af9 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-ee94cf77-5405-4e7c-b0ee-4b3d48e5b1c8-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-e3f548ff-19fe-4b4a-95b1-484e22c01d5a-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-e3f548ff-19fe-4b4a-95b1-484e22c01d5a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-quobyte-e3f548ff-19fe-4b4a-95b1-484e22c01d5a" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-e3f548ff-19fe-4b4a-95b1-484e22c01d5a" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3da4c7-92af-4439-9238-58bc37385cd4]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:11 devstack sudo[112112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a Aug 24 10:11:11 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:12 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a" returned: 0 in 0.355s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:12 devstack sudo[112117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a Aug 24 10:11:12 devstack sudo[112117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:12 devstack sudo[112117]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-e3f548ff-19fe-4b4a-95b1-484e22c01d5a" returned: 0 in 0.243s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-e3f548ff-19fe-4b4a-95b1-484e22c01d5a" released by "delete_volume" :: held 0.642s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Created reservations ['363070bb-972a-45fb-b2e7-5f7f2e0e552c', '499c90f2-a356-46c5-bd90-29cf9c3aad82', 'bff0279d-33c9-41a9-82a5-f97202cf4a6b', 'b9d79580-c7db-4d76-b33d-1ba857d08328'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:12 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:12 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:12 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.255s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Deleted volume successfully. Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b1af5e5d-5c00-42a1-8dd2-acc68c5b1c11 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-e3f548ff-19fe-4b4a-95b1-484e22c01d5a-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-9b42bc60-05f8-4830-929f-3224ec0cef4c-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-9b42bc60-05f8-4830-929f-3224ec0cef4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-quobyte-9b42bc60-05f8-4830-929f-3224ec0cef4c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-9b42bc60-05f8-4830-929f-3224ec0cef4c" acquired by "delete_volume" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[527da773-a46c-4150-93cd-9fd98915ba70]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:13 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c Aug 24 10:11:13 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:13 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:13 devstack sudo[112128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c Aug 24 10:11:13 devstack sudo[112128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:13 devstack sudo[112128]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9b42bc60-05f8-4830-929f-3224ec0cef4c" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-9b42bc60-05f8-4830-929f-3224ec0cef4c" released by "delete_volume" :: held 0.752s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Created reservations ['525d9ee0-a22a-415c-839c-a3b49f52d026', 'b38327cf-9c31-4974-843f-5d478536638c', '8ab2cb81-788b-49ec-a58a-028c6f3d5c7b', '745f912e-70b5-440c-baf8-10c3a7191bb6'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:13 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:13 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:14 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.312s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Deleted volume successfully. Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-quobyte-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88655df3-9a55-4cdc-a0a5-8fbad9392c80 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-9b42bc60-05f8-4830-929f-3224ec0cef4c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4708c4a0-f875-4765-bd7b-7863a3e448fa]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:14 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea Aug 24 10:11:14 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:14 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea" returned: 0 in 0.361s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:14 devstack sudo[112139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea Aug 24 10:11:14 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:14 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea" released by "delete_volume" :: held 0.676s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Created reservations ['6035ee0a-0599-4a92-8fc9-42499a7df247', '388f9070-ed8b-49b6-8ad2-e8c14282ee46', 'a8f41840-6658-4044-a314-61a60f409c9f', 'e6482fe4-0b4f-4b72-9e17-71d36916f528'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:15 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:15 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-376a13c4-286f-4991-ae95-037060f56c79-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-376a13c4-286f-4991-ae95-037060f56c79-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "cinder-quobyte-376a13c4-286f-4991-ae95-037060f56c79" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-376a13c4-286f-4991-ae95-037060f56c79" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[514cdc04-40b2-4e76-a41b-8a22ad1b1048]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:15 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.347s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Deleted volume successfully. Aug 24 10:11:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7e5eb6ef-e7e7-4c2a-8c6f-f29a17a4b96a tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-10b1d79e-cd61-40f3-8ae1-6fd3d9a7a0ea-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:15 devstack sudo[112147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 Aug 24 10:11:15 devstack sudo[112147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:16 devstack sudo[112147]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79" returned: 0 in 0.401s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:16 devstack sudo[112152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79 Aug 24 10:11:16 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:16 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-376a13c4-286f-4991-ae95-037060f56c79" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-quobyte-376a13c4-286f-4991-ae95-037060f56c79" released by "delete_volume" :: held 0.720s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Created reservations ['14f469b5-5678-4639-9ac9-e0f9d8c33a0d', 'e2091fdc-01c9-4edf-9803-2f8174e40258', '0285a586-a4ab-4d79-9c6c-67d7ee65afaf', 'a8043d74-53d1-4da8-8b17-c40288bd52fe'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:16 devstack sudo[112155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:16 devstack sudo[112155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:16 devstack sudo[112155]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Deleted volume successfully. Aug 24 10:11:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4be46a46-c7fc-430d-94de-921ec64febc7 tempest-CreateVolumesFromImageTest-1556983751 None] Lock "cinder-376a13c4-286f-4991-ae95-037060f56c79-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Flow 'volume_create_manager' (51f41926-0c5e-4a44-8dc9-00523363f86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a14c49-9d18-42d4-b66f-d3935de81664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a14c49-9d18-42d4-b66f-d3935de81664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2037502416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e293847-d9fc-4780-a610-e460a17355e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9dc7f3ff644c0580ffd6dc1ba8cddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:20Z,use_quota=True,user_id='298fb9b54e014c7cbb834549ab084f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e05734-cb46-49fe-925a-3b9bc4408576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e05734-cb46-49fe-925a-3b9bc4408576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb891f7-bb73-4d41-a620-549246489f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb891f7-bb73-4d41-a620-549246489f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e293847-d9fc-4780-a610-e460a17355e7', 'volume_name': 'volume-5e293847-d9fc-4780-a610-e460a17355e7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7041f5-ae5f-4ffe-ba8f-3d14191a620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7041f5-ae5f-4ffe-ba8f-3d14191a620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f023fb-e038-4099-a495-021ee15f310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Volume 5e293847-d9fc-4780-a610-e460a17355e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e293847-d9fc-4780-a610-e460a17355e7', 'volume_size': 1} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2037502416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e293847-d9fc-4780-a610-e460a17355e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9dc7f3ff644c0580ffd6dc1ba8cddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:20Z,use_quota=True,user_id='298fb9b54e014c7cbb834549ab084f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Creating volume 5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:20 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:20 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 1073741824 Aug 24 10:11:20 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:20 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 1073741824" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:20 devstack sudo[112204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 Aug 24 10:11:20 devstack sudo[112204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:20 devstack sudo[112204]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7" returned: 0 in 0.232s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f023fb-e038-4099-a495-021ee15f310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e293847-d9fc-4780-a610-e460a17355e7', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46e331a-1579-4be9-bc0a-8a7a0290eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Volume volume-5e293847-d9fc-4780-a610-e460a17355e7 (5e293847-d9fc-4780-a610-e460a17355e7): created successfully Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46e331a-1579-4be9-bc0a-8a7a0290eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Flow 'volume_create_manager' (51f41926-0c5e-4a44-8dc9-00523363f86f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4daae990-0881-4b24-bdae-2d6ac8a80853 tempest-VolumeDependencyTests-1662876967 None] Created volume successfully. Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Creating offline snapshot fa5a96a3-890a-4795-9007-a9f4570b933a of volume 5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b6c443-b7cc-4280-b16e-47420a4febca]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:21 devstack sudo[112208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 Aug 24 10:11:21 devstack sudo[112208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:21 devstack sudo[112208]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:21 devstack sudo[112213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a 1G Aug 24 10:11:21 devstack sudo[112213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:21 devstack sudo[112213]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a 1G" returned: 0 in 0.380s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e293847-d9fc-4780-a610-e460a17355e7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:21 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e293847-d9fc-4780-a610-e460a17355e7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a Aug 24 10:11:21 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:22 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e293847-d9fc-4780-a610-e460a17355e7 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a" returned: 0 in 0.279s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:22 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a is being set with open permissions: ugo+rw Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:22 devstack sudo[112223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a Aug 24 10:11:22 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:22 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a" returned: 0 in 0.233s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:22 devstack sudo[112226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info Aug 24 10:11:22 devstack sudo[112226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:22 devstack sudo[112226]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info" returned: 0 in 0.239s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:22 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info is being set with open permissions: ugo+rw Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:22 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info Aug 24 10:11:22 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:22 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.info" returned: 0 in 0.231s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-40a31c92-5e0b-4ca6-9aa9-07f0bc317798 tempest-VolumeDependencyTests-1662876967 None] Create snapshot completed successfully Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Flow 'volume_create_manager' (e1c62f71-be91-402c-9870-69a8ece124a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f332c92-0dba-4c18-85ea-ecf35604367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f332c92-0dba-4c18-85ea-ecf35604367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1062108048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd79f48-73d9-4f53-9a47-9884b909fe07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f9dc7f3ff644c0580ffd6dc1ba8cddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa5a96a3-890a-4795-9007-a9f4570b933a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:11:24Z,use_quota=True,user_id='298fb9b54e014c7cbb834549ab084f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426d5619-98c3-4c48-bf1a-b6688e9de870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426d5619-98c3-4c48-bf1a-b6688e9de870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbc72a6-1a4a-4770-8514-edb7bf1b237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbc72a6-1a4a-4770-8514-edb7bf1b237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fd79f48-73d9-4f53-9a47-9884b909fe07', 'volume_name': 'volume-2fd79f48-73d9-4f53-9a47-9884b909fe07', 'volume_size': 1, 'snapshot_id': 'fa5a96a3-890a-4795-9007-a9f4570b933a'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8593e814-ab62-49e6-bf0f-9e228aa3025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8593e814-ab62-49e6-bf0f-9e228aa3025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa700ba-e226-4b8b-ba81-8c687d3d9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Volume 2fd79f48-73d9-4f53-9a47-9884b909fe07: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fd79f48-73d9-4f53-9a47-9884b909fe07', 'volume_size': 1, 'snapshot_id': 'fa5a96a3-890a-4795-9007-a9f4570b933a'} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-quobyte-fa5a96a3-890a-4795-9007-a9f4570b933a-2fd79f48-73d9-4f53-9a47-9884b909fe07" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-fa5a96a3-890a-4795-9007-a9f4570b933a-2fd79f48-73d9-4f53-9a47-9884b909fe07" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Creating volume 2fd79f48-73d9-4f53-9a47-9884b909fe07 from snapshot fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-quobyte-2fd79f48-73d9-4f53-9a47-9884b909fe07" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-2fd79f48-73d9-4f53-9a47-9884b909fe07" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] snapshot: fa5a96a3-890a-4795-9007-a9f4570b933a, volume: 2fd79f48-73d9-4f53-9a47-9884b909fe07, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[13610485-bb99-4fb6-a470-75475d66b201]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:24 devstack sudo[112232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a Aug 24 10:11:24 devstack sudo[112232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:24 devstack sudo[112232]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a" returned: 0 in 0.345s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e293847-d9fc-4780-a610-e460a17355e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[320c3edc-1425-4b47-88e1-61c2299c5222]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:24 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 Aug 24 10:11:24 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:24 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7" returned: 0 in 0.337s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:11:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:24 devstack sudo[112243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 Aug 24 10:11:24 devstack sudo[112243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:26 devstack sudo[112255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:26 devstack sudo[112255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:26 devstack sudo[112255]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.441s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:11:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:11:29 devstack sudo[112243]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07" returned: 0 in 4.604s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:11:29 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Converted 1024.00 MB image at 222.38 MB/s Aug 24 10:11:29 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 is being set with open permissions: ugo+rw Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:29 devstack sudo[112263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 Aug 24 10:11:29 devstack sudo[112263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:29 devstack sudo[112263]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-2fd79f48-73d9-4f53-9a47-9884b909fe07" released by "_copy_volume_from_snapshot" :: held 5.633s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-fa5a96a3-890a-4795-9007-a9f4570b933a-2fd79f48-73d9-4f53-9a47-9884b909fe07" released by "_create_volume_from_snapshot" :: held 5.697s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.713s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa700ba-e226-4b8b-ba81-8c687d3d9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd79f48-73d9-4f53-9a47-9884b909fe07', 'volume_size': 1, 'snapshot_id': 'fa5a96a3-890a-4795-9007-a9f4570b933a'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1facf86c-c400-463d-b4be-1de647f98a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:11:29 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Volume volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 (2fd79f48-73d9-4f53-9a47-9884b909fe07): created successfully Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1facf86c-c400-463d-b4be-1de647f98a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:11:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Flow 'volume_create_manager' (e1c62f71-be91-402c-9870-69a8ece124a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:11:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-44d8c93e-c49e-4e06-82f4-033637d0ad12 tempest-VolumeDependencyTests-1662876967 None] Created volume successfully. Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-fa5a96a3-890a-4795-9007-a9f4570b933a-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-fa5a96a3-890a-4795-9007-a9f4570b933a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-quobyte-5e293847-d9fc-4780-a610-e460a17355e7" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-5e293847-d9fc-4780-a610-e460a17355e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-quobyte-fa5a96a3-890a-4795-9007-a9f4570b933a" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-fa5a96a3-890a-4795-9007-a9f4570b933a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Deleting offline snapshot fa5a96a3-890a-4795-9007-a9f4570b933a of volume 5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] snapshot_file for this snap is: volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a424f-d6c0-462a-a199-28582e4b8761]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:30 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a Aug 24 10:11:30 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:30 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a" returned: 0 in 0.402s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e293847-d9fc-4780-a610-e460a17355e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0080d891-7894-497d-acf1-9e6ba393c3a8]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:30 devstack sudo[112277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 Aug 24 10:11:30 devstack sudo[112277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:31 devstack sudo[112277]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7" returned: 0 in 0.621s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:31 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a Aug 24 10:11:31 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:31 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a" returned: 0 in 0.373s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:31 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a Aug 24 10:11:31 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:32 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7.fa5a96a3-890a-4795-9007-a9f4570b933a" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-fa5a96a3-890a-4795-9007-a9f4570b933a" released by "_delete_snapshot" :: held 1.783s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-5e293847-d9fc-4780-a610-e460a17355e7" released by "delete_snapshot" :: held 1.806s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Created reservations ['98984ef4-776d-483e-ac84-87ac3826b16c', '2012c1ac-0e69-430e-85b3-ef61b060e961', '7d5465b0-e574-4260-9386-3f30dc51764b', 'e7822e26-d294-4319-89e9-ab1512305ebc'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Delete snapshot completed successfully. Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-9bf8b323-9270-4048-8cb8-eaf32c0dc300 tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-fa5a96a3-890a-4795-9007-a9f4570b933a-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-5e293847-d9fc-4780-a610-e460a17355e7-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-5e293847-d9fc-4780-a610-e460a17355e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-quobyte-5e293847-d9fc-4780-a610-e460a17355e7" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-5e293847-d9fc-4780-a610-e460a17355e7" acquired by "delete_volume" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f106624-6014-4a38-868e-8868b5c68425]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:32 devstack sudo[112300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 Aug 24 10:11:32 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:33 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7" returned: 0 in 0.429s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:33 devstack sudo[112314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7 Aug 24 10:11:33 devstack sudo[112314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:33 devstack sudo[112314]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e293847-d9fc-4780-a610-e460a17355e7" returned: 0 in 0.366s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-5e293847-d9fc-4780-a610-e460a17355e7" released by "delete_volume" :: held 0.866s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-048367cd-9d4e-46cf-9431-74dc051ac4fa req-c4f7fc0a-b263-4313-abb9-208b0f9b199b tempest-TestShelveInstance-1865760990 None] Terminate volume connection completed successfully. Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-048367cd-9d4e-46cf-9431-74dc051ac4fa req-c4f7fc0a-b263-4313-abb9-208b0f9b199b tempest-TestShelveInstance-1865760990 None] Deleting attachment bd79d4d3-3e70-4cdb-88df-28f8ccf0d78a. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Created reservations ['8f2acb2f-111f-459b-b72e-9500f3b7c864', '5bff7da0-2b07-4bdd-947b-bde93ec0590c', 'dc6caafb-a087-42e4-9492-4d13466a3b45', '1a4e33e6-829b-416d-a134-c51c41d447ec'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:33 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:33 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-2fd79f48-73d9-4f53-9a47-9884b909fe07-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-2fd79f48-73d9-4f53-9a47-9884b909fe07-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "cinder-quobyte-2fd79f48-73d9-4f53-9a47-9884b909fe07" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-2fd79f48-73d9-4f53-9a47-9884b909fe07" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4ea66e-3b7c-4e55-88fc-867b405bf5f1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:33 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.348s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:33 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Deleted volume successfully. Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5e7707be-4661-41dc-a878-d57b4c51322c tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-5e293847-d9fc-4780-a610-e460a17355e7-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:34 devstack sudo[112330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 Aug 24 10:11:34 devstack sudo[112330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:34 devstack sudo[112330]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07" returned: 0 in 0.389s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:34 devstack sudo[112335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07 Aug 24 10:11:34 devstack sudo[112335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:34 devstack sudo[112335]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2fd79f48-73d9-4f53-9a47-9884b909fe07" returned: 0 in 0.235s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-quobyte-2fd79f48-73d9-4f53-9a47-9884b909fe07" released by "delete_volume" :: held 0.686s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Created reservations ['5ea7b394-7989-4ad9-b2fd-4a1b57eeebcc', 'd9951314-5741-416e-b587-b9f5f54b2da6', '679de6ac-835e-4bf0-92e1-d8dc4c6173da', '8cb8a3d0-8490-45fa-8b9c-fa83ba530544'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:11:34 devstack sudo[112338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:11:34 devstack sudo[112338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:11:34 devstack sudo[112338]: pam_unix(sudo:session): session closed for user root Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.234s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:11:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Deleted volume successfully. Aug 24 10:11:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-424c5eb4-ad24-4c60-9e7e-a0b70fcc701d tempest-VolumeDependencyTests-1662876967 None] Lock "cinder-2fd79f48-73d9-4f53-9a47-9884b909fe07-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:11:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f37cddda-aa98-4f27-990c-9215047be27c req-b9c34d0b-63af-4b13-bf03-0b0267c8e965 tempest-TestShelveInstance-1865760990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:11:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f37cddda-aa98-4f27-990c-9215047be27c req-b9c34d0b-63af-4b13-bf03-0b0267c8e965 tempest-TestShelveInstance-1865760990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:11:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-f37cddda-aa98-4f27-990c-9215047be27c req-b9c34d0b-63af-4b13-bf03-0b0267c8e965 tempest-TestShelveInstance-1865760990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:11:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-f37cddda-aa98-4f27-990c-9215047be27c req-b9c34d0b-63af-4b13-bf03-0b0267c8e965 tempest-TestShelveInstance-1865760990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c', 'name': 'volume-84774584-dda0-48c4-859f-78ff23bc3540', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6d32713-aca7-4198-9b29-10904d9d77e6', 'enforce_multipath': True} {{(pid=94039) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 24 10:11:37 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-f37cddda-aa98-4f27-990c-9215047be27c req-b9c34d0b-63af-4b13-bf03-0b0267c8e965 tempest-TestShelveInstance-1865760990 None] attachment_update completed successfully. Aug 24 10:11:47 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=85,cinder:INSERT=27,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:11:47 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=94,cinder:UPDATE=93,cinder:INSERT=31,cinder:DELETE=7 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:12:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-152fbf03-0b5d-4a77-859c-db77e892f0fb tempest-TestShelveInstance-1865760990 None] Terminate volume connection completed successfully. Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-152fbf03-0b5d-4a77-859c-db77e892f0fb tempest-TestShelveInstance-1865760990 None] Deleting attachment f6d32713-aca7-4198-9b29-10904d9d77e6. {{(pid=94039) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Acquiring lock "cinder-84774584-dda0-48c4-859f-78ff23bc3540-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Lock "cinder-84774584-dda0-48c4-859f-78ff23bc3540-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Acquiring lock "cinder-quobyte-84774584-dda0-48c4-859f-78ff23bc3540" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Lock "cinder-quobyte-84774584-dda0-48c4-859f-78ff23bc3540" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d7145-c3af-4ea9-8795-eb5c5d77cf89]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:07 devstack sudo[112933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 Aug 24 10:12:07 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:07 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540" returned: 0 in 0.396s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:07 devstack sudo[112938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540 Aug 24 10:12:07 devstack sudo[112938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:07 devstack sudo[112938]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-84774584-dda0-48c4-859f-78ff23bc3540" returned: 0 in 0.253s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Lock "cinder-quobyte-84774584-dda0-48c4-859f-78ff23bc3540" released by "delete_volume" :: held 0.698s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG cinder.quota [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Created reservations ['a1fad07c-fff5-451e-aa77-15a4d0b87989', 'a857ea22-c5d9-4bdd-af18-714f3b632d84', '9c338019-e65e-46bc-adcb-9d52d54d3ff2', '04d39750-e3b6-4558-bbf8-be6d0db31380'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:07 devstack sudo[112941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:07 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:08 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.258s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:08 devstack cinder-volume[94039]: DEBUG cinder.manager [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Deleted volume successfully. Aug 24 10:12:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [req-e0efb1f2-37b9-4ed6-a5f9-91cf2e25ded1 req-fd45232c-ccb5-4a4f-9f0e-37f73c2b9d9d tempest-TestShelveInstance-1865760990 None] Lock "cinder-84774584-dda0-48c4-859f-78ff23bc3540-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:17 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:12:18 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:12:18 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (b96785cf-4686-40e1-88e6-b045f139f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d618ae76-2c46-4b31-8279-3e3d229f5710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d618ae76-2c46-4b31-8279-3e3d229f5710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002747802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ff7f4f-7b4a-47e8-8811-13e65da9af2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:19Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e134e8bc-e4f4-45d0-bb2d-d36bd64fb61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e134e8bc-e4f4-45d0-bb2d-d36bd64fb61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b4854f-68e9-4134-85af-9c66b7e6fa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b4854f-68e9-4134-85af-9c66b7e6fa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ff7f4f-7b4a-47e8-8811-13e65da9af2f', 'volume_name': 'volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a70e9d8-53a7-4b0c-888f-a48617342329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a70e9d8-53a7-4b0c-888f-a48617342329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c422f7-b766-42ac-bf36-68b27e2df6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume d1ff7f4f-7b4a-47e8-8811-13e65da9af2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f', 'volume_size': 1} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002747802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ff7f4f-7b4a-47e8-8811-13e65da9af2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:19Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating volume d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:19 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:19 devstack sudo[112951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f 1073741824 Aug 24 10:12:19 devstack sudo[112951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:19 devstack sudo[112951]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f 1073741824" returned: 0 in 0.398s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:19 devstack sudo[112956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f Aug 24 10:12:19 devstack sudo[112956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:19 devstack sudo[112956]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" returned: 0 in 0.255s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6c422f7-b766-42ac-bf36-68b27e2df6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f4402-8014-4a1d-8fc5-a4d51349684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f (d1ff7f4f-7b4a-47e8-8811-13e65da9af2f): created successfully Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5f4402-8014-4a1d-8fc5-a4d51349684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (b96785cf-4686-40e1-88e6-b045f139f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:19 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-083093cf-30df-4d60-8301-2a632265742d tempest-CreateVolumesFromSnapshotTest-980420239 None] Created volume successfully. Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating offline snapshot 238bc3c2-eda2-43bc-941a-6113f908e22c of volume d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac75eb9f-218e-4273-b6b4-c836bec52ab4]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:20 devstack sudo[112959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f Aug 24 10:12:20 devstack sudo[112959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:20 devstack sudo[112959]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" returned: 0 in 0.348s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:20 devstack sudo[112964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c 1G Aug 24 10:12:20 devstack sudo[112964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:20 devstack sudo[112964]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c 1G" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:20 devstack sudo[112970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c Aug 24 10:12:20 devstack sudo[112970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:21 devstack sudo[112970]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c" returned: 0 in 0.288s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:21 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c is being set with open permissions: ugo+rw Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:21 devstack sudo[112977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c Aug 24 10:12:21 devstack sudo[112977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:21 devstack sudo[112977]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c" returned: 0 in 0.235s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:21 devstack sudo[112980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info Aug 24 10:12:21 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:21 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info" returned: 0 in 0.254s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:21 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info is being set with open permissions: ugo+rw Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:21 devstack sudo[112983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info Aug 24 10:12:21 devstack sudo[112983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:21 devstack sudo[112983]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.info" returned: 0 in 0.235s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-95a1bb51-97ea-4cad-9ca9-96555295f37f tempest-CreateVolumesFromSnapshotTest-980420239 None] Create snapshot completed successfully Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (99bd0594-7595-4d52-bf71-0e07a712c238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f12b20e-a372-49d7-a3e6-b5c06b7784ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f12b20e-a372-49d7-a3e6-b5c06b7784ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-455134578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794690da-0eee-4610-8f9b-2e5e590da297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:23Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c4cffa-b449-4310-bd48-a8fd5070fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c4cffa-b449-4310-bd48-a8fd5070fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7affbcef-8fc3-4625-bf98-5cd50923d09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7affbcef-8fc3-4625-bf98-5cd50923d09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794690da-0eee-4610-8f9b-2e5e590da297', 'volume_name': 'volume-794690da-0eee-4610-8f9b-2e5e590da297', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e234f70-6329-4d96-96c3-232625505904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e234f70-6329-4d96-96c3-232625505904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8622c11a-efd6-4379-b7ee-07b74b87d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:22 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume 794690da-0eee-4610-8f9b-2e5e590da297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794690da-0eee-4610-8f9b-2e5e590da297', 'volume_size': 1} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-455134578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794690da-0eee-4610-8f9b-2e5e590da297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:23Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating volume 794690da-0eee-4610-8f9b-2e5e590da297 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:22 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:22 devstack sudo[112986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 1073741824 Aug 24 10:12:22 devstack sudo[112986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (20b0a264-1765-4937-9409-c7dc02213d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77144afa-b812-4333-9779-a00b41199fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77144afa-b812-4333-9779-a00b41199fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1575121707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48716611-111f-4767-9417-18ae153f68a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:23Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2167fff2-3ef6-401e-8cae-a9c603fa82c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2167fff2-3ef6-401e-8cae-a9c603fa82c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccd50e7-6966-41b5-ae24-878f6b9895a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccd50e7-6966-41b5-ae24-878f6b9895a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48716611-111f-4767-9417-18ae153f68a6', 'volume_name': 'volume-48716611-111f-4767-9417-18ae153f68a6', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba751a4d-16a2-4451-ad59-8a4a7fdcd723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba751a4d-16a2-4451-ad59-8a4a7fdcd723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d332428-2630-49a0-b7b9-cb9e99be480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume 48716611-111f-4767-9417-18ae153f68a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48716611-111f-4767-9417-18ae153f68a6', 'volume_size': 1} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:23 devstack sudo[112986]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 1073741824" returned: 0 in 0.536s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:23 devstack sudo[112992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 Aug 24 10:12:23 devstack sudo[112992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (1e7a47b1-af81-43d6-b746-5eb84e6d5791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28287a77-eaa3-4cbe-962c-e2efd3e9872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28287a77-eaa3-4cbe-962c-e2efd3e9872b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-352950671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fea4c96-b99e-4267-a35e-c068542c0137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:23Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6ef21e-2d01-4ba7-8e9a-be82f48a1030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6ef21e-2d01-4ba7-8e9a-be82f48a1030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120351ef-cf99-4601-9116-d44db1bc01c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120351ef-cf99-4601-9116-d44db1bc01c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fea4c96-b99e-4267-a35e-c068542c0137', 'volume_name': 'volume-5fea4c96-b99e-4267-a35e-c068542c0137', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8481b60-7f2c-4b72-a238-1449152e667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8481b60-7f2c-4b72-a238-1449152e667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e9ab3e-dc4a-409b-b53e-20a747eda294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume 5fea4c96-b99e-4267-a35e-c068542c0137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fea4c96-b99e-4267-a35e-c068542c0137', 'volume_size': 1} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:23 devstack sudo[112992]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297" returned: 0 in 0.274s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1575121707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48716611-111f-4767-9417-18ae153f68a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:23Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating volume 48716611-111f-4767-9417-18ae153f68a6 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:23 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8622c11a-efd6-4379-b7ee-07b74b87d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794690da-0eee-4610-8f9b-2e5e590da297', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack sudo[112995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 1073741824 Aug 24 10:12:23 devstack sudo[112995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d9f68c-abe6-4dd8-935a-fedd794cc9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume volume-794690da-0eee-4610-8f9b-2e5e590da297 (794690da-0eee-4610-8f9b-2e5e590da297): created successfully Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d9f68c-abe6-4dd8-935a-fedd794cc9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (99bd0594-7595-4d52-bf71-0e07a712c238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-56d5ac29-8152-46bc-9eb9-cf7b9cc24a60 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created volume successfully. Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (ff75ec83-38dc-4a19-bff6-4039bd9318ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26400c5c-c1f2-44c4-b72e-c420e3aa1c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26400c5c-c1f2-44c4-b72e-c420e3aa1c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1794091552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5302e3c-5450-46f6-9d0a-6b2a916ecf5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:24Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f859344a-978d-40bf-91c7-9bad19d0476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f859344a-978d-40bf-91c7-9bad19d0476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb867298-fb63-4c83-ba81-76d922c96cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb867298-fb63-4c83-ba81-76d922c96cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5302e3c-5450-46f6-9d0a-6b2a916ecf5e', 'volume_name': 'volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff275bc-c254-492c-876e-900feca3ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff275bc-c254-492c-876e-900feca3ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1258cb-8b28-4d0c-91cb-87de0718ba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume b5302e3c-5450-46f6-9d0a-6b2a916ecf5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e', 'volume_size': 1} Aug 24 10:12:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (5ed6b3fb-f645-47fd-8bd7-4315c6d804a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658c11d8-0858-4608-9bff-45c69e748a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658c11d8-0858-4608-9bff-45c69e748a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919161991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd866a9-ca37-40a0-ab71-a71e0b1dcffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:24Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a267ecb5-530c-44b1-b020-45fbd2d05bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a267ecb5-530c-44b1-b020-45fbd2d05bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369c46a8-4a04-4036-be46-ad19d4e3ba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369c46a8-4a04-4036-be46-ad19d4e3ba8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd866a9-ca37-40a0-ab71-a71e0b1dcffe', 'volume_name': 'volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df88add-3066-4875-ad19-6b0ac9e1868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df88add-3066-4875-ad19-6b0ac9e1868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cd367f-935b-41c3-a001-e475f9c57722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume 3fd866a9-ca37-40a0-ab71-a71e0b1dcffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe', 'volume_size': 1} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:24 devstack sudo[112995]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 1073741824" returned: 0 in 0.534s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:24 devstack sudo[113001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 Aug 24 10:12:24 devstack sudo[113001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:24 devstack sudo[113001]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6" returned: 0 in 0.239s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-352950671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fea4c96-b99e-4267-a35e-c068542c0137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:23Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating volume 5fea4c96-b99e-4267-a35e-c068542c0137 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:24 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d332428-2630-49a0-b7b9-cb9e99be480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48716611-111f-4767-9417-18ae153f68a6', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:24 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 1073741824 Aug 24 10:12:24 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa3d5f2-5277-44fa-acad-7e39cdc0ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume volume-48716611-111f-4767-9417-18ae153f68a6 (48716611-111f-4767-9417-18ae153f68a6): created successfully Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa3d5f2-5277-44fa-acad-7e39cdc0ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (20b0a264-1765-4937-9409-c7dc02213d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ff6bfb54-57aa-491c-ab0b-2025648f3e38 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created volume successfully. Aug 24 10:12:24 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 1073741824" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:24 devstack sudo[113009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 Aug 24 10:12:24 devstack sudo[113009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:25 devstack sudo[113009]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1794091552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5302e3c-5450-46f6-9d0a-6b2a916ecf5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:24Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating volume b5302e3c-5450-46f6-9d0a-6b2a916ecf5e {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:25 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:25 devstack sudo[113012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e 1073741824 Aug 24 10:12:25 devstack sudo[113012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e9ab3e-dc4a-409b-b53e-20a747eda294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fea4c96-b99e-4267-a35e-c068542c0137', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d865a2-5c71-4708-8954-29c9abdecc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume volume-5fea4c96-b99e-4267-a35e-c068542c0137 (5fea4c96-b99e-4267-a35e-c068542c0137): created successfully Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d865a2-5c71-4708-8954-29c9abdecc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (1e7a47b1-af81-43d6-b746-5eb84e6d5791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-704321e0-8ef9-473c-8b6b-517665acb207 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created volume successfully. Aug 24 10:12:25 devstack sudo[113012]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e 1073741824" returned: 0 in 0.406s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:25 devstack sudo[113017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e Aug 24 10:12:25 devstack sudo[113017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:25 devstack sudo[113017]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.771s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919161991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd866a9-ca37-40a0-ab71-a71e0b1dcffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a52b9b987eb47c9a72429f6760a1f24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:24Z,use_quota=True,user_id='7fa3eec1d34a4a01a3367530681f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Creating volume 3fd866a9-ca37-40a0-ab71-a71e0b1dcffe {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:25 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1258cb-8b28-4d0c-91cb-87de0718ba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:25 devstack sudo[113020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe 1073741824 Aug 24 10:12:25 devstack sudo[113020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc6e89-7b4b-496b-bb7f-7ecfbf6cc59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e (b5302e3c-5450-46f6-9d0a-6b2a916ecf5e): created successfully Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cc6e89-7b4b-496b-bb7f-7ecfbf6cc59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (ff75ec83-38dc-4a19-bff6-4039bd9318ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d4abe6d5-40bd-47b4-95da-d22e8748e4ef tempest-CreateVolumesFromSnapshotTest-980420239 None] Created volume successfully. Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:26 devstack sudo[113025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:26 devstack sudo[113025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:26 devstack sudo[113020]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe 1073741824" returned: 0 in 0.439s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:26 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe Aug 24 10:12:26 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:26 devstack sudo[113025]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.256s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:12:26 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe" returned: 0 in 0.236s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cd367f-935b-41c3-a001-e475f9c57722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f2dfe4-f227-42cc-8af0-2dd8c75c60cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:26 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Volume volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe (3fd866a9-ca37-40a0-ab71-a71e0b1dcffe): created successfully Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f2dfe4-f227-42cc-8af0-2dd8c75c60cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Flow 'volume_create_manager' (5ed6b3fb-f645-47fd-8bd7-4315c6d804a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5a9613dc-f75a-47c1-ba32-1678f446492c tempest-CreateVolumesFromSnapshotTest-980420239 None] Created volume successfully. Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[736023e5-609d-479a-ac0d-0de6c11192a6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:27 devstack sudo[113032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe Aug 24 10:12:27 devstack sudo[113032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:27 devstack sudo[113032]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe" returned: 0 in 0.342s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:27 devstack sudo[113038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe Aug 24 10:12:27 devstack sudo[113038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:28 devstack sudo[113038]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe" returned: 0 in 0.230s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe" released by "delete_volume" :: held 0.605s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['01e7a43b-2976-4dc3-a997-d74ddaf9b53c', 'cc7fe22e-059c-4eb6-85c9-dc36cb57733e', 'd9199c08-df56-406e-a5c3-1c46028a598c', 'e71274d7-aadc-4a10-9d17-3018f1c99a18'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:28 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:28 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:28 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.237s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleted volume successfully. Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-871e248c-cf93-43f1-8224-46e243c29c89 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-3fd866a9-ca37-40a0-ab71-a71e0b1dcffe-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e" acquired by "delete_volume" :: waited 0.013s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[832dfa8b-5f53-412a-b6dd-a4d2ebcc31de]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:28 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e Aug 24 10:12:28 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:29 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:29 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e Aug 24 10:12:29 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:29 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e" returned: 0 in 0.232s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e" released by "delete_volume" :: held 0.611s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['c02e6398-9092-44f4-b52a-ef8dbf777b95', '0f769894-fd46-474c-bf9d-2f656882354d', 'e885731e-8637-4675-a104-9b20d1afd566', '1e7c08aa-df30-4e09-8b2e-6c95a84caf73'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:29 devstack sudo[113052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:29 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:29 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.231s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleted volume successfully. Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0c836385-b723-419d-b7ea-b4b6a6e58135 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-b5302e3c-5450-46f6-9d0a-6b2a916ecf5e-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-5fea4c96-b99e-4267-a35e-c068542c0137-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-5fea4c96-b99e-4267-a35e-c068542c0137-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-5fea4c96-b99e-4267-a35e-c068542c0137" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-5fea4c96-b99e-4267-a35e-c068542c0137" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[65551148-e627-483b-95a0-eda69798e0d5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:29 devstack sudo[113055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 Aug 24 10:12:29 devstack sudo[113055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:30 devstack sudo[113055]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137" returned: 0 in 0.343s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:30 devstack sudo[113060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137 Aug 24 10:12:30 devstack sudo[113060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:30 devstack sudo[113060]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5fea4c96-b99e-4267-a35e-c068542c0137" returned: 0 in 0.243s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-5fea4c96-b99e-4267-a35e-c068542c0137" released by "delete_volume" :: held 0.620s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['6ee53019-9625-4a87-8938-8609d59264b1', 'dd18dbd0-1ea1-4c49-a02c-a4f862f81ca0', '8f47a231-2da9-4c16-928a-02a7c0c7bed2', '0c15a9ee-9e94-4331-8b71-02bbda7910d0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:30 devstack sudo[113063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:30 devstack sudo[113063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:30 devstack sudo[113063]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.232s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleted volume successfully. Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de11518f-9cd6-4a85-9b50-597e545373d2 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-5fea4c96-b99e-4267-a35e-c068542c0137-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-48716611-111f-4767-9417-18ae153f68a6-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-48716611-111f-4767-9417-18ae153f68a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-48716611-111f-4767-9417-18ae153f68a6" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-48716611-111f-4767-9417-18ae153f68a6" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997e15a-9b3d-4c42-9180-6f13a4f5ff62]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:31 devstack sudo[113067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 Aug 24 10:12:31 devstack sudo[113067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:31 devstack sudo[113067]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6" returned: 0 in 0.337s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:31 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6 Aug 24 10:12:31 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:31 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-48716611-111f-4767-9417-18ae153f68a6" returned: 0 in 0.237s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-48716611-111f-4767-9417-18ae153f68a6" released by "delete_volume" :: held 0.609s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['ea9ed667-7f7b-41e4-875b-4e5d6c5e59a8', 'ed28d277-807d-4ca3-8150-3f47c675bf35', '99109494-6d93-4418-9129-b50bec1a65c6', '8a9d11c5-f3b2-457d-8943-b1c6b3db40f1'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:31 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:31 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:31 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.237s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleted volume successfully. Aug 24 10:12:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b8ff54dc-75fa-4546-8e4a-fbe044bf4b17 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-48716611-111f-4767-9417-18ae153f68a6-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-794690da-0eee-4610-8f9b-2e5e590da297-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-794690da-0eee-4610-8f9b-2e5e590da297-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-794690da-0eee-4610-8f9b-2e5e590da297" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-794690da-0eee-4610-8f9b-2e5e590da297" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f826c1e2-8dba-4bb5-b012-ee62ac36b2d6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:32 devstack sudo[113078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 Aug 24 10:12:32 devstack sudo[113078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:32 devstack sudo[113078]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297" returned: 0 in 0.347s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:32 devstack sudo[113083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297 Aug 24 10:12:32 devstack sudo[113083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:32 devstack sudo[113083]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-794690da-0eee-4610-8f9b-2e5e590da297" returned: 0 in 0.229s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-794690da-0eee-4610-8f9b-2e5e590da297" released by "delete_volume" :: held 0.614s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['ef8af1f1-0939-46db-88b5-3392c68a4755', '6a7e5af1-6fb3-4eb8-8634-ab7b1a782323', '312e93b0-ed97-4d37-8f86-849def41d7b4', 'c6e06523-7776-464a-9c99-f872f87abd88'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:32 devstack sudo[113086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:32 devstack sudo[113086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:33 devstack sudo[113086]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.249s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:33 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleted volume successfully. Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-32eb7aa5-c0b0-4209-bf73-08e5aa5196fb tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-794690da-0eee-4610-8f9b-2e5e590da297-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-238bc3c2-eda2-43bc-941a-6113f908e22c-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-238bc3c2-eda2-43bc-941a-6113f908e22c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-238bc3c2-eda2-43bc-941a-6113f908e22c" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-238bc3c2-eda2-43bc-941a-6113f908e22c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleting offline snapshot 238bc3c2-eda2-43bc-941a-6113f908e22c of volume d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] snapshot_file for this snap is: volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f951fc1-0476-41e9-8ce7-9fd7a78a6f07]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:33 devstack sudo[113089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c Aug 24 10:12:33 devstack sudo[113089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:33 devstack sudo[113089]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c" returned: 0 in 0.352s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[305c07f4-7a77-459f-a67d-c90e45a9e121]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:33 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f Aug 24 10:12:33 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:34 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" returned: 0 in 0.336s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:34 devstack sudo[113100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c Aug 24 10:12:34 devstack sudo[113100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:34 devstack sudo[113100]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c" returned: 0 in 0.318s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:34 devstack sudo[113105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c Aug 24 10:12:34 devstack sudo[113105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:34 devstack sudo[113105]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f.238bc3c2-eda2-43bc-941a-6113f908e22c" returned: 0 in 0.230s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-238bc3c2-eda2-43bc-941a-6113f908e22c" released by "_delete_snapshot" :: held 1.328s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" released by "delete_snapshot" :: held 1.352s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['d1deabab-37c1-4573-b517-70ed902d2037', '56f43e91-8608-42a6-8927-e8a7206ce38b', '8cd3864a-c6d3-4b77-b2a9-0446f8c2394d', 'c6e7f7b0-4f0c-4920-b417-254502d0b9d8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Delete snapshot completed successfully. Aug 24 10:12:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-16fd69c2-7720-45f6-a0e5-e3bd10bbf43f tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-238bc3c2-eda2-43bc-941a-6113f908e22c-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "cinder-quobyte-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdf1ae2-3f1e-413d-85a4-d4e6bfb4baa3]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:35 devstack sudo[113108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f Aug 24 10:12:35 devstack sudo[113108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:35 devstack sudo[113108]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:35 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f Aug 24 10:12:35 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:36 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" returned: 0 in 0.239s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-quobyte-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f" released by "delete_volume" :: held 0.652s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Created reservations ['9d017f21-6629-455a-a86c-9e604066d855', 'a53c8d5b-ab42-4480-9852-6591c27ddbcb', '2559bd3b-9d46-48c8-87fa-40f40d0e6bc7', '2a8745d9-d2aa-4e1a-ab5d-2447d7dca740'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:36 devstack sudo[113152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:12:36 devstack sudo[113152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:36 devstack sudo[113152]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.234s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:12:36 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Deleted volume successfully. Aug 24 10:12:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1f93ff81-11af-4a6d-91e6-d7c6d01f3fc0 tempest-CreateVolumesFromSnapshotTest-980420239 None] Lock "cinder-d1ff7f4f-7b4a-47e8-8811-13e65da9af2f-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:12:46 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:12:46 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=71,cinder:SELECT=44,cinder:DELETE=6,cinder:INSERT=20 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (35536b2d-6eff-4490-8070-05425ab06fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be110bc-b759-4b7f-a9f2-ecd232c840f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be110bc-b759-4b7f-a9f2-ecd232c840f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1836130231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dc5b77-889c-4ceb-a6b9-cc08962a847d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:57Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe88e50-fe4e-4f45-929f-94718eebb436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe88e50-fe4e-4f45-929f-94718eebb436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d77816-3f65-44d3-bd1e-62c53f0bb04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d77816-3f65-44d3-bd1e-62c53f0bb04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64dc5b77-889c-4ceb-a6b9-cc08962a847d', 'volume_name': 'volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b5f8ee-1061-4fab-a5ff-46676191f86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b5f8ee-1061-4fab-a5ff-46676191f86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b69897-eddc-4369-9cb3-259288acd0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Volume 64dc5b77-889c-4ceb-a6b9-cc08962a847d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d', 'volume_size': 1} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1836130231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64dc5b77-889c-4ceb-a6b9-cc08962a847d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:57Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Creating volume 64dc5b77-889c-4ceb-a6b9-cc08962a847d {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:57 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (fea72d4a-4530-40a1-a254-4b4ff50b02f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:57 devstack sudo[113205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d 1073741824 Aug 24 10:12:57 devstack sudo[113205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1777a52-ffc2-40d7-b07e-c38a3d9d56e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1777a52-ffc2-40d7-b07e-c38a3d9d56e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844085564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7e442e-df1e-4e00-96cb-01a51be1dcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:57Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344d2fe1-d245-469c-849a-c8b347ff8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344d2fe1-d245-469c-849a-c8b347ff8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d75ecb-dce5-4635-8a12-5ca7030f618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d75ecb-dce5-4635-8a12-5ca7030f618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7e442e-df1e-4e00-96cb-01a51be1dcda', 'volume_name': 'volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3961773-651b-4e8b-a98d-2c222b3b8fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3961773-651b-4e8b-a98d-2c222b3b8fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016ee47e-0997-4fef-b528-40952a7a5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume 5f7e442e-df1e-4e00-96cb-01a51be1dcda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda', 'volume_size': 1} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (fd44086e-b210-45fd-9de0-d37c1b7da1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9947c52a-06ab-4163-986e-d969135a866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9947c52a-06ab-4163-986e-d969135a866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802523586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9035587c-aa9e-4b20-ad45-c91a9a56b717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:57Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44d9079-0de6-4ab7-ab62-aa9bbb33c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44d9079-0de6-4ab7-ab62-aa9bbb33c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1ba9a7-a848-482a-902b-6a71added300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1ba9a7-a848-482a-902b-6a71added300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9035587c-aa9e-4b20-ad45-c91a9a56b717', 'volume_name': 'volume-9035587c-aa9e-4b20-ad45-c91a9a56b717', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e34dd7-1f29-405d-ab0c-4b8eb33c0b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e34dd7-1f29-405d-ab0c-4b8eb33c0b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5907a8-3924-4a0b-be94-043cebae6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Volume 9035587c-aa9e-4b20-ad45-c91a9a56b717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9035587c-aa9e-4b20-ad45-c91a9a56b717', 'volume_size': 1} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (e1ed554c-450f-470b-ac64-6c402b774599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b97db1-5d45-432c-a925-8d8e0cbf93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b97db1-5d45-432c-a925-8d8e0cbf93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-857166925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d80bc07-64f4-4795-b4cd-8c043d2187b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:58Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f53e3f-bc7f-4680-ac21-3e6bb191a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f53e3f-bc7f-4680-ac21-3e6bb191a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61b375a-231d-4412-b448-8ce78c16e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61b375a-231d-4412-b448-8ce78c16e99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d80bc07-64f4-4795-b4cd-8c043d2187b5', 'volume_name': 'volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e99324d-f0dc-411a-b21f-ada0e85da9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e99324d-f0dc-411a-b21f-ada0e85da9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8854da3b-49b3-44f6-9d2a-c438c42f7194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:57 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Volume 3d80bc07-64f4-4795-b4cd-8c043d2187b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5', 'volume_size': 1} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:57 devstack sudo[113205]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d 1073741824" returned: 0 in 0.736s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:57 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d Aug 24 10:12:57 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (ecb7f6a0-314f-47df-bac9-9684ffd35e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add1cb8a-97da-4708-b391-e3ff9554c81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add1cb8a-97da-4708-b391-e3ff9554c81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290122641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219bba4f-d0d2-4a53-8fcd-da86d71a3f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:58Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da92b2e5-d50c-4b38-97cb-158db4281bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da92b2e5-d50c-4b38-97cb-158db4281bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a1659-4e7d-4903-b6ab-cd9495bb7e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000a1659-4e7d-4903-b6ab-cd9495bb7e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219bba4f-d0d2-4a53-8fcd-da86d71a3f76', 'volume_name': 'volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b745ef-b07b-4f41-8a09-0fbc2af94b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b745ef-b07b-4f41-8a09-0fbc2af94b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406a81a2-689b-4819-b2a7-077314a096d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Volume 219bba4f-d0d2-4a53-8fcd-da86d71a3f76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76', 'volume_size': 1} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:58 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d" returned: 0 in 0.408s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844085564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7e442e-df1e-4e00-96cb-01a51be1dcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:57Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating volume 5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:58 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b69897-eddc-4369-9cb3-259288acd0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf38cd5-5453-4dbd-860d-a75dfca3568e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Volume volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d (64dc5b77-889c-4ceb-a6b9-cc08962a847d): created successfully Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf38cd5-5453-4dbd-860d-a75dfca3568e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack sudo[113214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda 1073741824 Aug 24 10:12:58 devstack sudo[113214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (35536b2d-6eff-4490-8070-05425ab06fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:58 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6d9a2ac7-adaf-457f-959b-42cedf6f7eeb tempest-CreateVolumesFromImageTest-1921266652 None] Created volume successfully. Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (19f240be-3159-4290-8df6-1bf36da48950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03836e0a-be9a-4e02-b8a8-985b0d490a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03836e0a-be9a-4e02-b8a8-985b0d490a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297945667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3603c7-5819-4269-b737-b3fb0f5b6444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:59Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a748228-7daf-4eb5-8a67-a624535c8b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a748228-7daf-4eb5-8a67-a624535c8b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4d40b7-a113-4a2a-867b-9e62e24a54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4d40b7-a113-4a2a-867b-9e62e24a54db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3603c7-5819-4269-b737-b3fb0f5b6444', 'volume_name': 'volume-5e3603c7-5819-4269-b737-b3fb0f5b6444', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03f10f0-72cd-45d1-941f-52d73788e481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03f10f0-72cd-45d1-941f-52d73788e481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f7abfe-2c18-4b69-a392-5fef3bc3bade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Volume 5e3603c7-5819-4269-b737-b3fb0f5b6444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3603c7-5819-4269-b737-b3fb0f5b6444', 'volume_size': 1} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:58 devstack sudo[113214]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda 1073741824" returned: 0 in 0.584s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:59 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda Aug 24 10:12:59 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:59 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802523586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9035587c-aa9e-4b20-ad45-c91a9a56b717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:57Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Creating volume 9035587c-aa9e-4b20-ad45-c91a9a56b717 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:12:59 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:59 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 1073741824 Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016ee47e-0997-4fef-b528-40952a7a5203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd5be8b-d998-4ca6-b78d-dbe80752ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:12:59 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:12:59 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda (5f7e442e-df1e-4e00-96cb-01a51be1dcda): created successfully Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd5be8b-d998-4ca6-b78d-dbe80752ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (fea72d4a-4530-40a1-a254-4b4ff50b02f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:12:59 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-35a21917-ba3b-490c-b551-327516a2c5bd tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created volume successfully. Aug 24 10:12:59 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 1073741824" returned: 0 in 0.575s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:12:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:12:59 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 Aug 24 10:12:59 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:00 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717" returned: 0 in 0.308s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.487s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-857166925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d80bc07-64f4-4795-b4cd-8c043d2187b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:58Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Creating volume 3d80bc07-64f4-4795-b4cd-8c043d2187b5 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:00 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5907a8-3924-4a0b-be94-043cebae6976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9035587c-aa9e-4b20-ad45-c91a9a56b717', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42182366-f0b1-41f4-bf38-c21ffa9c8596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:00 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 1073741824 Aug 24 10:13:00 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:00 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Volume volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 (9035587c-aa9e-4b20-ad45-c91a9a56b717): created successfully Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42182366-f0b1-41f4-bf38-c21ffa9c8596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (fd44086e-b210-45fd-9de0-d37c1b7da1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-960af7d6-bd90-440f-9ff4-13a1a8ae873f tempest-CreateVolumesFromImageTest-1921266652 None] Created volume successfully. Aug 24 10:13:00 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 1073741824" returned: 0 in 0.556s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:00 devstack sudo[113240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 Aug 24 10:13:00 devstack sudo[113240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:01 devstack sudo[113240]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5" returned: 0 in 0.268s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290122641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219bba4f-d0d2-4a53-8fcd-da86d71a3f76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:58Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Creating volume 219bba4f-d0d2-4a53-8fcd-da86d71a3f76 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:01 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8854da3b-49b3-44f6-9d2a-c438c42f7194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:01 devstack sudo[113244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 1073741824 Aug 24 10:13:01 devstack sudo[113244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7ce7d-e258-43c2-ad69-72a321c582c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:01 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Volume volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 (3d80bc07-64f4-4795-b4cd-8c043d2187b5): created successfully Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7ce7d-e258-43c2-ad69-72a321c582c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (e1ed554c-450f-470b-ac64-6c402b774599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-67dd97b9-3674-4312-bfb8-84bf0508e2bb tempest-CreateVolumesFromImageTest-1921266652 None] Created volume successfully. Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Flow 'volume_create_manager' (09d7746e-2856-4000-91f6-a34d12bd662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd899d4-872c-4ce8-a9d2-93224152d517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd899d4-872c-4ce8-a9d2-93224152d517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260b89c8-1385-4406-857c-00f8fadef0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eb1d6166724b38b518cc8fe02c6d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:01Z,use_quota=True,user_id='27a63be2398f48359bf37716c667b04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e54777-2677-4ed7-a76c-13fa99b4af57),volume_type_id=98e54777-2677-4ed7-a76c-13fa99b4af57)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6ab335-a5c1-4e51-a24a-e9a143b702f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6ab335-a5c1-4e51-a24a-e9a143b702f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4c5882-2d14-43eb-a78f-1d6e0c0d91bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:13:01 devstack sudo[113244]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 1073741824" returned: 0 in 0.504s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:01 devstack sudo[113250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 Aug 24 10:13:01 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4c5882-2d14-43eb-a78f-1d6e0c0d91bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '260b89c8-1385-4406-857c-00f8fadef0f1', 'volume_name': 'volume-260b89c8-1385-4406-857c-00f8fadef0f1', 'volume_size': 1, 'image_id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00072096-e2a0-4440-9047-b28d69d75ff0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2f4f6a2a2011fab2e4f20f8b01e3879', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64eb1d6166724b38b518cc8fe02c6d5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0dd9959655d33b94f669d57ecf527ec0214a0eb33cddf50672ce38f289d154bebb27fe40f8e698485fce593abf66eae49b382c701e15df86e45764be71d0dc4f', 'id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'created_at': datetime.datetime(2026, 8, 24, 8, 12, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00072096-e2a0-4440-9047-b28d69d75ff0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b1629c-88ca-4b1a-9190-7a62c22cbd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:01 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b1629c-88ca-4b1a-9190-7a62c22cbd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab370817-b9c3-4029-9b17-5ad14c93eb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:01 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Volume 260b89c8-1385-4406-857c-00f8fadef0f1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-260b89c8-1385-4406-857c-00f8fadef0f1', 'volume_size': 1, 'image_id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00072096-e2a0-4440-9047-b28d69d75ff0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2f4f6a2a2011fab2e4f20f8b01e3879', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64eb1d6166724b38b518cc8fe02c6d5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0dd9959655d33b94f669d57ecf527ec0214a0eb33cddf50672ce38f289d154bebb27fe40f8e698485fce593abf66eae49b382c701e15df86e45764be71d0dc4f', 'id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'created_at': datetime.datetime(2026, 8, 24, 8, 12, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00072096-e2a0-4440-9047-b28d69d75ff0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Trying to clone 260b89c8-1385-4406-857c-00f8fadef0f1 from image 00072096-e2a0-4440-9047-b28d69d75ff0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00072096-e2a0-4440-9047-b28d69d75ff0', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1297945667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3603c7-5819-4269-b737-b3fb0f5b6444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1c0244dd4da4b32a638b44c3313c9a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:12:59Z,use_quota=True,user_id='d047692815244045945ff772388e6e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Creating volume 5e3603c7-5819-4269-b737-b3fb0f5b6444 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:02 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (406a81a2-689b-4819-b2a7-077314a096d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:02 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 1073741824 Aug 24 10:13:02 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c6ece2-ff4c-4561-8e5c-be1a2f1a8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Volume volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 (219bba4f-d0d2-4a53-8fcd-da86d71a3f76): created successfully Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c6ece2-ff4c-4561-8e5c-be1a2f1a8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (ecb7f6a0-314f-47df-bac9-9684ffd35e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5327a55f-7518-4c12-87fe-44eb797d09cb tempest-CreateVolumesFromImageTest-1921266652 None] Created volume successfully. Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:13:02 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Image download 0.00 MB at 0.00 MB/s Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb333b7c-92be-4e77-bcea-13f2944edcd9]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:02 devstack sudo[113255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD Aug 24 10:13:02 devstack sudo[113255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:02 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 1073741824" returned: 0 in 0.482s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:02 devstack sudo[113255]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:02 devstack sudo[113263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 Aug 24 10:13:02 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:02 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD Aug 24 10:13:02 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:02 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444" returned: 0 in 0.289s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.658s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f7abfe-2c18-4b69-a392-5fef3bc3bade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3603c7-5819-4269-b737-b3fb0f5b6444', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1321f70b-fcdc-46b1-8956-3ad2d48aa664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating offline snapshot 7950f093-7df3-42bb-8560-54176901e654 of volume 5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:13:02 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Volume volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 (5e3603c7-5819-4269-b737-b3fb0f5b6444): created successfully Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1321f70b-fcdc-46b1-8956-3ad2d48aa664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Flow 'volume_create_manager' (19f240be-3159-4290-8df6-1bf36da48950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56c3436-2936-45a8-b4de-11115ab9567e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Temporary image 00072096-e2a0-4440-9047-b28d69d75ff0 is fetched for user 27a63be2398f48359bf37716c667b04c. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:13:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f553c708-2a17-4554-9df3-4da5c62aa89b tempest-CreateVolumesFromImageTest-1921266652 None] Created volume successfully. Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70bea30-95e3-430a-b4e8-b1981d516258]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:03 devstack sudo[113270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda Aug 24 10:13:03 devstack sudo[113270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD Aug 24 10:13:03 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-5e3603c7-5819-4269-b737-b3fb0f5b6444-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-5e3603c7-5819-4269-b737-b3fb0f5b6444-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-quobyte-5e3603c7-5819-4269-b737-b3fb0f5b6444" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-5e3603c7-5819-4269-b737-b3fb0f5b6444" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7e5d8-ad29-4046-88b8-e850ea12a861]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:03 devstack sudo[113270]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:03 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:03 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 1G Aug 24 10:13:03 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 Aug 24 10:13:03 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack sudo[113281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD Aug 24 10:13:03 devstack sudo[113281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444" returned: 0 in 0.400s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:03 devstack sudo[113281]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:03 devstack sudo[113294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444 Aug 24 10:13:03 devstack sudo[113294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 1G" returned: 0 in 0.443s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:03 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 Aug 24 10:13:03 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:03 devstack sudo[113294]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5e3603c7-5819-4269-b737-b3fb0f5b6444" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-5e3603c7-5819-4269-b737-b3fb0f5b6444" released by "delete_volume" :: held 0.700s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Created reservations ['108609ab-93e9-4025-9b5e-0f2ee1112269', '82aefc62-21f6-488c-956e-5d2a1ff1886b', '1085234b-3cd2-452e-a022-b61a3f0478ff', 'f4839590-44ad-45b9-a2ee-1981d3704212'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:04 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:04 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:04 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654" returned: 0 in 0.333s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:04 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 is being set with open permissions: ugo+rw Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:04 devstack sudo[113304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 Aug 24 10:13:04 devstack sudo[113304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-219bba4f-d0d2-4a53-8fcd-da86d71a3f76-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-219bba4f-d0d2-4a53-8fcd-da86d71a3f76-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:04 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-quobyte-219bba4f-d0d2-4a53-8fcd-da86d71a3f76" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.339s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:04 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Deleted volume successfully. Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-219bba4f-d0d2-4a53-8fcd-da86d71a3f76" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:04 devstack sudo[113304]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654" returned: 0 in 0.357s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a42249fc-a726-4e8c-9ac1-751ebacb5c80 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-5e3603c7-5819-4269-b737-b3fb0f5b6444-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb0396f-5234-4059-9e78-b6a0ba55c502]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:04 devstack sudo[113309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info Aug 24 10:13:04 devstack sudo[113309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:04 devstack sudo[113308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 Aug 24 10:13:04 devstack sudo[113308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:04 devstack sudo[113309]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info" returned: 0 in 0.266s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:04 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info is being set with open permissions: ugo+rw Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:04 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info Aug 24 10:13:04 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:04 devstack sudo[113308]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76" returned: 0 in 0.394s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:04 devstack sudo[113318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76 Aug 24 10:13:04 devstack sudo[113318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:05 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.info" returned: 0 in 0.315s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260b89c8-1385-4406-857c-00f8fadef0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eb1d6166724b38b518cc8fe02c6d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:01Z,use_quota=True,user_id='27a63be2398f48359bf37716c667b04c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98e54777-2677-4ed7-a76c-13fa99b4af57),volume_type_id=98e54777-2677-4ed7-a76c-13fa99b4af57)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Creating volume 260b89c8-1385-4406-857c-00f8fadef0f1 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:05 devstack sudo[113318]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:05 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-219bba4f-d0d2-4a53-8fcd-da86d71a3f76" returned: 0 in 0.293s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:05 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 1073741824 Aug 24 10:13:05 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-219bba4f-d0d2-4a53-8fcd-da86d71a3f76" released by "delete_volume" :: held 0.753s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-02f37478-492a-4871-8b06-cc601d144b5e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Create snapshot completed successfully Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Created reservations ['f0720a52-a161-4e6a-9077-22a841a2f5ea', 'f0d902eb-0365-4cda-8d83-fb39e49bbade', '0585fdeb-b12e-455d-ae7d-cd9c7d906f2b', '3d935dad-6063-48f9-b012-28af8cc7efe3'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:05 devstack sudo[113326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:05 devstack sudo[113326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-3d80bc07-64f4-4795-b4cd-8c043d2187b5-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-3d80bc07-64f4-4795-b4cd-8c043d2187b5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-quobyte-3d80bc07-64f4-4795-b4cd-8c043d2187b5" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-3d80bc07-64f4-4795-b4cd-8c043d2187b5" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee30ab7-caea-45cb-8897-9585436d6647]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:05 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 1073741824" returned: 0 in 0.582s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:05 devstack sudo[113326]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.427s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:05 devstack sudo[113332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 Aug 24 10:13:05 devstack sudo[113332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Deleted volume successfully. Aug 24 10:13:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a174e3b6-47c6-4140-92bf-8d1243f8ca33 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-219bba4f-d0d2-4a53-8fcd-da86d71a3f76-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:05 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 Aug 24 10:13:05 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (0e1df114-989e-4b58-8f39-acecd2eb7485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7d9f9a-03df-4ea2-89eb-69da47bdae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7d9f9a-03df-4ea2-89eb-69da47bdae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657992989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bdd0df-2914-4218-9b2f-5396359fd2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:06Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53748272-fd4c-4e3f-b7c0-8f961b40e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53748272-fd4c-4e3f-b7c0-8f961b40e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac54df-d13a-4b99-b6f3-869a0343f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ac54df-d13a-4b99-b6f3-869a0343f43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2bdd0df-2914-4218-9b2f-5396359fd2af', 'volume_name': 'volume-b2bdd0df-2914-4218-9b2f-5396359fd2af', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f82d470-5721-4f76-9b7d-18cc88f12e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f82d470-5721-4f76-9b7d-18cc88f12e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393285e4-36ff-42fe-8af8-eacfc7bbe89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume b2bdd0df-2914-4218-9b2f-5396359fd2af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2bdd0df-2914-4218-9b2f-5396359fd2af', 'volume_size': 1} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:06 devstack sudo[113332]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657992989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bdd0df-2914-4218-9b2f-5396359fd2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:06Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating volume b2bdd0df-2914-4218-9b2f-5396359fd2af {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:06 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af 1073741824 Aug 24 10:13:06 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:06 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Attempting download of 00072096-e2a0-4440-9047-b28d69d75ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/00072096-e2a0-4440-9047-b28d69d75ff0', 'metadata': {}}])) to volume 260b89c8-1385-4406-857c-00f8fadef0f1. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5" returned: 0 in 0.574s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:06 devstack sudo[113341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5 Aug 24 10:13:06 devstack sudo[113341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f407b-1927-469a-9ac8-1cb39eaeb0a2]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:06 devstack sudo[113343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7 Aug 24 10:13:06 devstack sudo[113343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (f0b1ac08-c459-46db-bf2e-4880309fcdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3460d6b1-dd43-45db-a707-c5964e11927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3460d6b1-dd43-45db-a707-c5964e11927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718733174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9ce627-4818-4e50-b897-9509c894aa88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:07Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4862c657-3264-4732-be76-71c2866552ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4862c657-3264-4732-be76-71c2866552ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fce0ce-65a1-4ffe-a285-6ceff49180b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack sudo[113341]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2fce0ce-65a1-4ffe-a285-6ceff49180b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9ce627-4818-4e50-b897-9509c894aa88', 'volume_name': 'volume-dc9ce627-4818-4e50-b897-9509c894aa88', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a124c3c-ee6d-4686-93cb-b6f180070930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a124c3c-ee6d-4686-93cb-b6f180070930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93511f4-c8ac-4f1b-88e5-c1455956dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume dc9ce627-4818-4e50-b897-9509c894aa88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9ce627-4818-4e50-b897-9509c894aa88', 'volume_size': 1} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-3d80bc07-64f4-4795-b4cd-8c043d2187b5" returned: 0 in 0.562s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-3d80bc07-64f4-4795-b4cd-8c043d2187b5" released by "delete_volume" :: held 1.208s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Created reservations ['75bfc2e6-5616-4bf2-9ca0-7168c2783fdb', '6f15fa68-a6eb-4f8b-b3ce-f01c1c523c91', '367aa35f-99e4-409e-9b1a-682910848c91', 'ccd0eb4c-6d0b-4027-a2c6-aa26b13ecd20'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:06 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af 1073741824" returned: 0 in 0.780s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:06 devstack sudo[113343]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7" returned: 0 in 0.607s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:07 devstack sudo[113352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:07 devstack sudo[113352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:07 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af Aug 24 10:13:07 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:07 devstack sudo[113351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7 Aug 24 10:13:07 devstack sudo[113351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (a7f8443d-4277-4da1-88f2-3dc3739fc715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d91eb1-1bb0-4386-9c71-0a8567ee573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d91eb1-1bb0-4386-9c71-0a8567ee573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906767456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61c5cf6-82c2-4c09-98e3-5f86abb30250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:07Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b775d3-6186-4072-a1cf-fc1aa1e37f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b775d3-6186-4072-a1cf-fc1aa1e37f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb06c497-f295-46da-a117-e49fb5e9e4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb06c497-f295-46da-a117-e49fb5e9e4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61c5cf6-82c2-4c09-98e3-5f86abb30250', 'volume_name': 'volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7492860-934a-4f32-9bd4-7586b8c93487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7492860-934a-4f32-9bd4-7586b8c93487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a12d8c-1bea-479f-94c5-c1baaf741a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume a61c5cf6-82c2-4c09-98e3-5f86abb30250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250', 'volume_size': 1} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-9035587c-aa9e-4b20-ad45-c91a9a56b717-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-9035587c-aa9e-4b20-ad45-c91a9a56b717-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:07 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af" returned: 0 in 0.449s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718733174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9ce627-4818-4e50-b897-9509c894aa88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:07Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating volume dc9ce627-4818-4e50-b897-9509c894aa88 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:07 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:07 devstack sudo[113358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 1073741824 Aug 24 10:13:07 devstack sudo[113358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393285e4-36ff-42fe-8af8-eacfc7bbe89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bdd0df-2914-4218-9b2f-5396359fd2af', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec56645-3280-4af1-94e3-cb32be1eb080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-quobyte-9035587c-aa9e-4b20-ad45-c91a9a56b717" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume volume-b2bdd0df-2914-4218-9b2f-5396359fd2af (b2bdd0df-2914-4218-9b2f-5396359fd2af): created successfully Aug 24 10:13:07 devstack sudo[113351]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec56645-3280-4af1-94e3-cb32be1eb080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (0e1df114-989e-4b58-8f39-acecd2eb7485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-9035587c-aa9e-4b20-ad45-c91a9a56b717" acquired by "delete_volume" :: waited 0.072s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:07 devstack sudo[113352]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7" returned: 1 in 0.757s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00072096-e2a0-4440-9047-b28d69d75ff0_vqg2grh7' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.701s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec4e08c-9dcb-4a46-a5c2-815961a0435b]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Deleted volume successfully. Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6968f0f5-c9c4-42c1-ba62-c68380c7805c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c37971dd-9bd0-4419-b746-52f7f946ae05 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created volume successfully. Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f057d91b-1762-4001-9970-b838c51c496d tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-3d80bc07-64f4-4795-b4cd-8c043d2187b5-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:07 devstack sudo[113364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD Aug 24 10:13:07 devstack sudo[113364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:07 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 Aug 24 10:13:07 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (c165cbca-bb58-4f2d-9aeb-03455ca6f1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48f0086-9911-4bd5-8f11-ec9975a4c9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48f0086-9911-4bd5-8f11-ec9975a4c9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025317289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df4bc36-75fc-463b-9fab-c05a74f4dce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:08Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack sudo[113364]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db57daa0-9373-4ac8-b572-a4277d5f5a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db57daa0-9373-4ac8-b572-a4277d5f5a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d59ec4-9da2-4b42-a8a1-218cc4cb081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d59ec4-9da2-4b42-a8a1-218cc4cb081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df4bc36-75fc-463b-9fab-c05a74f4dce8', 'volume_name': 'volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a674d224-553a-42e5-be17-ee234e7a8e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a674d224-553a-42e5-be17-ee234e7a8e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack sudo[113358]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7cff5c-7929-4b88-b722-83b111722907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume 2df4bc36-75fc-463b-9fab-c05a74f4dce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8', 'volume_size': 1} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 1073741824" returned: 0 in 0.714s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:08 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717" returned: 0 in 0.572s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:08 devstack sudo[113377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:08 devstack sudo[113377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:08 devstack sudo[113379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717 Aug 24 10:13:08 devstack sudo[113379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:08 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD Aug 24 10:13:08 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (f1966dd3-eab9-42d8-bfa4-c5ca7845ed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b83434-d0ea-4e49-8d77-731b07ab4715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b83434-d0ea-4e49-8d77-731b07ab4715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-815251244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33311e51-c382-4b41-b2a2-45409d1efa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:09Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0833d76-15af-4e92-a15e-3920edc51512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0833d76-15af-4e92-a15e-3920edc51512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d971914a-a9ef-4c17-afdc-ce71ec1b59fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d971914a-a9ef-4c17-afdc-ce71ec1b59fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33311e51-c382-4b41-b2a2-45409d1efa33', 'volume_name': 'volume-33311e51-c382-4b41-b2a2-45409d1efa33', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab623765-685f-4aab-b7df-3c54f10d11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab623765-685f-4aab-b7df-3c54f10d11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9794cd6-dd8c-4097-889a-04d7f8554672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume 33311e51-c382-4b41-b2a2-45409d1efa33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33311e51-c382-4b41-b2a2-45409d1efa33', 'volume_size': 1} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:08 devstack sudo[113379]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9035587c-aa9e-4b20-ad45-c91a9a56b717" returned: 0 in 0.344s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:08 devstack sudo[113377]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-9035587c-aa9e-4b20-ad45-c91a9a56b717" released by "delete_volume" :: held 1.010s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88" returned: 0 in 0.400s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906767456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61c5cf6-82c2-4c09-98e3-5f86abb30250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:07Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating volume a61c5cf6-82c2-4c09-98e3-5f86abb30250 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:08 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:08 devstack sudo[113387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 1073741824 Aug 24 10:13:08 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93511f4-c8ac-4f1b-88e5-c1455956dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9ce627-4818-4e50-b897-9509c894aa88', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack sudo[113387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c2c063-e414-4e0b-a542-ece3d76a6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD" returned: 1 in 0.513s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] 00072096-e2a0-4440-9047-b28d69d75ff0 was raw, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:08 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume volume-dc9ce627-4818-4e50-b897-9509c894aa88 (dc9ce627-4818-4e50-b897-9509c894aa88): created successfully Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c2c063-e414-4e0b-a542-ece3d76a6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:08 devstack sudo[113389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (f0b1ac08-c459-46db-bf2e-4880309fcdd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:08 devstack sudo[113389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d6b616e5-7039-4eaf-84e3-9f4b5a4b7edf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created volume successfully. Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Created reservations ['d0fda326-0645-40c3-9c0d-98f1e8759f8d', '977173a2-100f-41f0-bffb-ff1bb49ff80a', '86004e1d-8e1d-41d1-82ae-a1d0b231d0a0', 'f765b15c-7a3d-46f8-8494-c54eb6408c02'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:08 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:09 devstack sudo[113391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:09 devstack sudo[113391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:09 devstack sudo[113391]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:09 devstack sudo[113387]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 1073741824" returned: 0 in 0.615s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Deleted volume successfully. Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8f4a9983-03b3-498e-bc79-150fac270712 tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-9035587c-aa9e-4b20-ad45-c91a9a56b717-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:09 devstack sudo[113389]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1" returned: 0 in 0.629s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00072096-e2a0-4440-9047-b28d69d75ff0_xb0vi89sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:13:09 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Converted 0.00 MB image at 0.00 MB/s Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:09 devstack sudo[113404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 Aug 24 10:13:09 devstack sudo[113404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:09 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 1G Aug 24 10:13:09 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:09 devstack sudo[113404]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250" returned: 0 in 0.270s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025317289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df4bc36-75fc-463b-9fab-c05a74f4dce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:08Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating volume 2df4bc36-75fc-463b-9fab-c05a74f4dce8 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:09 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a12d8c-1bea-479f-94c5-c1baaf741a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:09 devstack sudo[113412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 1073741824 Aug 24 10:13:09 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44b6f1d-c364-41ff-b941-8d32aff8e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-64dc5b77-889c-4ceb-a6b9-cc08962a847d-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:09 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 (a61c5cf6-82c2-4c09-98e3-5f86abb30250): created successfully Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44b6f1d-c364-41ff-b941-8d32aff8e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (a7f8443d-4277-4da1-88f2-3dc3739fc715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-bf7def51-cf68-4704-b35a-b1bbed1e0214 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created volume successfully. Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-64dc5b77-889c-4ceb-a6b9-cc08962a847d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "cinder-quobyte-64dc5b77-889c-4ceb-a6b9-cc08962a847d" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:09 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 1G" returned: 0 in 0.445s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Downloaded image 00072096-e2a0-4440-9047-b28d69d75ff0 ((None, [{'url': 'file:///opt/stack/data/glance/images/00072096-e2a0-4440-9047-b28d69d75ff0', 'metadata': {}}])) to volume 260b89c8-1385-4406-857c-00f8fadef0f1 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Temporary image 00072096-e2a0-4440-9047-b28d69d75ff0 for user 27a63be2398f48359bf37716c667b04c is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Marking volume 260b89c8-1385-4406-857c-00f8fadef0f1 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Copying metadata from image 00072096-e2a0-4440-9047-b28d69d75ff0 to 260b89c8-1385-4406-857c-00f8fadef0f1. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Creating volume glance metadata for volume 260b89c8-1385-4406-857c-00f8fadef0f1 backed by image 00072096-e2a0-4440-9047-b28d69d75ff0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd2f4f6a2a2011fab2e4f20f8b01e3879', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-64dc5b77-889c-4ceb-a6b9-cc08962a847d" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc1092f-b825-41ff-a199-1a866f257e35]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab370817-b9c3-4029-9b17-5ad14c93eb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260b89c8-1385-4406-857c-00f8fadef0f1', 'volume_size': 1, 'image_id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00072096-e2a0-4440-9047-b28d69d75ff0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2f4f6a2a2011fab2e4f20f8b01e3879', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '64eb1d6166724b38b518cc8fe02c6d5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0dd9959655d33b94f669d57ecf527ec0214a0eb33cddf50672ce38f289d154bebb27fe40f8e698485fce593abf66eae49b382c701e15df86e45764be71d0dc4f', 'id': '00072096-e2a0-4440-9047-b28d69d75ff0', 'created_at': datetime.datetime(2026, 8, 24, 8, 12, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00072096-e2a0-4440-9047-b28d69d75ff0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9eff57-d9fc-448b-b15f-394efe3b3551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Volume volume-260b89c8-1385-4406-857c-00f8fadef0f1 (260b89c8-1385-4406-857c-00f8fadef0f1): created successfully Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9eff57-d9fc-448b-b15f-394efe3b3551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Flow 'volume_create_manager' (09d7746e-2856-4000-91f6-a34d12bd662b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7630457f-9b71-496a-9d05-0ce87069ce5b tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Created volume successfully. Aug 24 10:13:10 devstack sudo[113414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d Aug 24 10:13:10 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Acquiring lock "cinder-260b89c8-1385-4406-857c-00f8fadef0f1-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:10 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 1073741824" returned: 0 in 0.641s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "cinder-260b89c8-1385-4406-857c-00f8fadef0f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Acquiring lock "cinder-quobyte-260b89c8-1385-4406-857c-00f8fadef0f1" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:10 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d" returned: 0 in 0.499s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:10 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 Aug 24 10:13:10 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "cinder-quobyte-260b89c8-1385-4406-857c-00f8fadef0f1" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:10 devstack sudo[113424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d Aug 24 10:13:10 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[34560d15-5f14-4961-a6c8-33eccad8d449]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:10 devstack sudo[113427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 Aug 24 10:13:10 devstack sudo[113427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:10 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64dc5b77-889c-4ceb-a6b9-cc08962a847d" returned: 0 in 0.325s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-quobyte-64dc5b77-889c-4ceb-a6b9-cc08962a847d" released by "delete_volume" :: held 0.868s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:10 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-815251244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33311e51-c382-4b41-b2a2-45409d1efa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa616ae69c14fefa5fc98118eae50e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:09Z,use_quota=True,user_id='9cedfdbb1b5e48269242b326c838cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Creating volume 33311e51-c382-4b41-b2a2-45409d1efa33 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:10 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7cff5c-7929-4b88-b722-83b111722907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:10 devstack sudo[113431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 1073741824 Aug 24 10:13:10 devstack sudo[113431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc70334-7eae-4d15-a055-531718522b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 (2df4bc36-75fc-463b-9fab-c05a74f4dce8): created successfully Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc70334-7eae-4d15-a055-531718522b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (c165cbca-bb58-4f2d-9aeb-03455ca6f1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:10 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Created reservations ['d51e1dd3-8402-4d21-84d9-e0f9987aa238', '5132842b-0e09-4da3-8ef7-2739ae29c30c', 'ec87e431-3b1e-4f97-bf95-e3d03f90e60f', '4546f160-74ff-4a35-9185-e5bdbc30ba41'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5cd7112f-dc22-4b99-a8d0-47f40afb1c3e tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created volume successfully. Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:11 devstack sudo[113427]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1" returned: 0 in 0.527s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:11 devstack sudo[113437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:11 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:11 devstack sudo[113438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1 Aug 24 10:13:11 devstack sudo[113438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:11 devstack sudo[113438]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-260b89c8-1385-4406-857c-00f8fadef0f1" returned: 0 in 0.277s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "cinder-quobyte-260b89c8-1385-4406-857c-00f8fadef0f1" released by "delete_volume" :: held 0.862s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:11 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.339s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Deleted volume successfully. Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-905b249c-da7e-4dda-8780-408c2dc9e47c tempest-CreateVolumesFromImageTest-1921266652 None] Lock "cinder-64dc5b77-889c-4ceb-a6b9-cc08962a847d-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Created reservations ['a406886e-d78b-40fd-9345-97a1dbb1f8f1', '6f17eef7-8f21-4d9f-a3a4-c0b9a5de1184', '74a8adfc-072c-452d-a3c6-3710e4bec93c', 'aa0e6b0d-e1a5-4746-85cf-2bde3dde3c7e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:11 devstack sudo[113431]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 1073741824" returned: 0 in 0.633s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:11 devstack sudo[113447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:11 devstack sudo[113447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:11 devstack sudo[113448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 Aug 24 10:13:11 devstack sudo[113448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:11 devstack sudo[113447]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:11 devstack sudo[113448]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33" returned: 0 in 0.270s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Deleted volume successfully. Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9794cd6-dd8c-4097-889a-04d7f8554672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33311e51-c382-4b41-b2a2-45409d1efa33', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a763d76-4b30-415b-9185-0599d6e5cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6a3d8dee-2a08-49c9-a01f-85f2b128ce91 tempest-VolumeAndVolumeTypeFromImageTest-1259586781 None] Lock "cinder-260b89c8-1385-4406-857c-00f8fadef0f1-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Volume volume-33311e51-c382-4b41-b2a2-45409d1efa33 (33311e51-c382-4b41-b2a2-45409d1efa33): created successfully Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a763d76-4b30-415b-9185-0599d6e5cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Flow 'volume_create_manager' (f1966dd3-eab9-42d8-bfa4-c5ca7845ed4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f318869f-157d-4e65-a64f-0bc006a63e8c tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created volume successfully. Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-33311e51-c382-4b41-b2a2-45409d1efa33-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-33311e51-c382-4b41-b2a2-45409d1efa33-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-33311e51-c382-4b41-b2a2-45409d1efa33" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-33311e51-c382-4b41-b2a2-45409d1efa33" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75baf08-5d8a-46c8-96d6-15fb3d3a2f11]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:12 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 Aug 24 10:13:12 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:12 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:12 devstack sudo[113458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33 Aug 24 10:13:12 devstack sudo[113458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:12 devstack sudo[113458]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-33311e51-c382-4b41-b2a2-45409d1efa33" returned: 0 in 0.305s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-33311e51-c382-4b41-b2a2-45409d1efa33" released by "delete_volume" :: held 0.782s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['54d5d7e2-3c57-43c2-8ee8-c5b279f50610', '181714f6-e06f-4099-b381-303c722e0f26', 'f5352022-7e9e-461f-bf6d-76aec95d0d3a', 'e7eefad1-b4c1-4467-8b31-49ed02c87010'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:13 devstack sudo[113461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:13 devstack sudo[113461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-2df4bc36-75fc-463b-9fab-c05a74f4dce8-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-2df4bc36-75fc-463b-9fab-c05a74f4dce8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-2df4bc36-75fc-463b-9fab-c05a74f4dce8" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-2df4bc36-75fc-463b-9fab-c05a74f4dce8" acquired by "delete_volume" :: waited 0.048s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363343a-ccb5-4cac-ac94-7bc74eb6c2cc]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:13 devstack sudo[113461]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.476s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleted volume successfully. Aug 24 10:13:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-88d97cd1-5355-4122-9859-d25285aca408 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-33311e51-c382-4b41-b2a2-45409d1efa33-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:13 devstack sudo[113463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 Aug 24 10:13:13 devstack sudo[113463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:14 devstack sudo[113463]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8" returned: 0 in 0.528s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:14 devstack sudo[113469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8 Aug 24 10:13:14 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (0309fca8-2f59-4785-941f-394370031b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da24301-9b0f-4ebd-9229-742e3c08cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da24301-9b0f-4ebd-9229-742e3c08cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281284623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e758c9-cc83-4983-8bdd-7e64fc879a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:14Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fb7660-c5dd-433b-a8d1-bb1b37672cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09fb7660-c5dd-433b-a8d1-bb1b37672cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afa3b94-cfa3-4d46-83a6-8a750cefa43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afa3b94-cfa3-4d46-83a6-8a750cefa43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e758c9-cc83-4983-8bdd-7e64fc879a20', 'volume_name': 'volume-26e758c9-cc83-4983-8bdd-7e64fc879a20', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893fa64d-f3b6-4e3e-8272-025e667cc1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893fa64d-f3b6-4e3e-8272-025e667cc1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6706014-a181-4b77-ad4b-54af7a5355c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:14 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Volume 26e758c9-cc83-4983-8bdd-7e64fc879a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e758c9-cc83-4983-8bdd-7e64fc879a20', 'volume_size': 1} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281284623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e758c9-cc83-4983-8bdd-7e64fc879a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:14Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Creating volume 26e758c9-cc83-4983-8bdd-7e64fc879a20 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:14 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:14 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 1073741824 Aug 24 10:13:14 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:14 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2df4bc36-75fc-463b-9fab-c05a74f4dce8" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-2df4bc36-75fc-463b-9fab-c05a74f4dce8" released by "delete_volume" :: held 0.892s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['a015725f-0fe8-4a1c-8bee-8e2bbc727f79', 'c723d4b4-faf7-4fb5-81ad-4d602f725afd', '8f803ca1-9dff-4d96-b19b-a5c82601aaaf', '80a616a4-c9ae-4ab6-afdb-12f0b77eb4e8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-a61c5cf6-82c2-4c09-98e3-5f86abb30250-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:14 devstack sudo[113477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-a61c5cf6-82c2-4c09-98e3-5f86abb30250-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:14 devstack sudo[113477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-a61c5cf6-82c2-4c09-98e3-5f86abb30250" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-a61c5cf6-82c2-4c09-98e3-5f86abb30250" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e494361b-9d55-4711-b26b-0ef7997c3ba9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:14 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 1073741824" returned: 0 in 0.642s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:14 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 Aug 24 10:13:14 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:14 devstack sudo[113481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 Aug 24 10:13:14 devstack sudo[113481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:15 devstack sudo[113477]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.497s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleted volume successfully. Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6fa744-97ee-45b5-98c0-1671dd244871 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-2df4bc36-75fc-463b-9fab-c05a74f4dce8-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:15 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250" returned: 0 in 0.508s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:15 devstack sudo[113487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250 Aug 24 10:13:15 devstack sudo[113487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:15 devstack sudo[113481]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20" returned: 0 in 0.385s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6706014-a181-4b77-ad4b-54af7a5355c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e758c9-cc83-4983-8bdd-7e64fc879a20', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db58508-2b94-4a27-b49a-c1ab070cf4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:15 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Volume volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 (26e758c9-cc83-4983-8bdd-7e64fc879a20): created successfully Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db58508-2b94-4a27-b49a-c1ab070cf4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (0309fca8-2f59-4785-941f-394370031b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:15 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8968cfc5-6e77-4b93-94a9-a75c82d5c497 tempest-ProjectReaderTests-243094432 None] Created volume successfully. Aug 24 10:13:15 devstack sudo[113487]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a61c5cf6-82c2-4c09-98e3-5f86abb30250" returned: 0 in 0.291s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-a61c5cf6-82c2-4c09-98e3-5f86abb30250" released by "delete_volume" :: held 0.865s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['20c56675-7872-4fe1-b99c-4bc35cef8319', 'd4a67612-e642-49bd-be99-f75fe2f7d3aa', 'c58a0553-e9dc-4e78-8f82-2bb5034b37e4', '4b79fcbe-b9e8-4b4b-a806-7f87070e13d2'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:15 devstack sudo[113491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:15 devstack sudo[113491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-dc9ce627-4818-4e50-b897-9509c894aa88-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-dc9ce627-4818-4e50-b897-9509c894aa88-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-dc9ce627-4818-4e50-b897-9509c894aa88" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-dc9ce627-4818-4e50-b897-9509c894aa88" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[5004d650-d217-4799-a5c5-786c476968af]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:16 devstack sudo[113491]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.448s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleted volume successfully. Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a1bf5fb8-50f7-4c82-8d41-b4c7ba940ddf tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-a61c5cf6-82c2-4c09-98e3-5f86abb30250-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:16 devstack sudo[113493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 Aug 24 10:13:16 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (535b1751-0b45-4b66-890c-a339b6e23505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba9c420-3d8d-412a-8dd3-63458a5ffb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba9c420-3d8d-412a-8dd3-63458a5ffb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1638167014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3bbc64-9902-4969-ac88-71155d54b665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:16Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b2685a-ec70-4e4e-952f-3418b6b6ac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b2685a-ec70-4e4e-952f-3418b6b6ac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a85e6d4-fcd8-4a1d-a754-386ca763af8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a85e6d4-fcd8-4a1d-a754-386ca763af8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3bbc64-9902-4969-ac88-71155d54b665', 'volume_name': 'volume-6d3bbc64-9902-4969-ac88-71155d54b665', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f039ad7-6f76-473b-8f12-905cf20a4820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f039ad7-6f76-473b-8f12-905cf20a4820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198908f8-8f32-4618-8263-56b258e58b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:16 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume 6d3bbc64-9902-4969-ac88-71155d54b665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3bbc64-9902-4969-ac88-71155d54b665', 'volume_size': 1} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1638167014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3bbc64-9902-4969-ac88-71155d54b665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:16Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Creating volume 6d3bbc64-9902-4969-ac88-71155d54b665 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:16 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:16 devstack sudo[113496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 1073741824 Aug 24 10:13:16 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:16 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88" returned: 0 in 0.561s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:16 devstack sudo[113501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88 Aug 24 10:13:16 devstack sudo[113501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-26e758c9-cc83-4983-8bdd-7e64fc879a20-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Lock "cinder-26e758c9-cc83-4983-8bdd-7e64fc879a20-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-quobyte-26e758c9-cc83-4983-8bdd-7e64fc879a20" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-26e758c9-cc83-4983-8bdd-7e64fc879a20" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5eb5d5-a646-4db0-98eb-d1a7f39b8332]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:16 devstack sudo[113501]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-dc9ce627-4818-4e50-b897-9509c894aa88" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:16 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 Aug 24 10:13:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-dc9ce627-4818-4e50-b897-9509c894aa88" released by "delete_volume" :: held 0.980s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:16 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:17 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['e5fc9a61-4034-44b1-bad0-7736ac671d55', 'c0d6f1b6-18bf-43fb-897d-23eab137ba4d', 'a9b6b33a-ed69-477e-9383-83e8614534d0', '51531f10-8c8c-4864-805a-cfc5b9aa0cbb'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 1073741824" returned: 0 in 0.603s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:17 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 Aug 24 10:13:17 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:17 devstack sudo[113512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:17 devstack sudo[113512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:17 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20" returned: 0 in 0.562s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:17 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665" returned: 0 in 0.300s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:17 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20 Aug 24 10:13:17 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198908f8-8f32-4618-8263-56b258e58b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3bbc64-9902-4969-ac88-71155d54b665', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6e44e3-3db2-4d7d-a227-cb416785789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:17 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume volume-6d3bbc64-9902-4969-ac88-71155d54b665 (6d3bbc64-9902-4969-ac88-71155d54b665): created successfully Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6e44e3-3db2-4d7d-a227-cb416785789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (535b1751-0b45-4b66-890c-a339b6e23505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7755a176-4fb4-4300-81f7-3e57b50e7f52 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created volume successfully. Aug 24 10:13:17 devstack sudo[113512]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.329s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleted volume successfully. Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c7f54127-42c7-486a-8517-45d755da950a tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-dc9ce627-4818-4e50-b897-9509c894aa88-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:17 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-26e758c9-cc83-4983-8bdd-7e64fc879a20" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-26e758c9-cc83-4983-8bdd-7e64fc879a20" released by "delete_volume" :: held 0.902s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Created reservations ['51891d2a-2201-4137-bf45-27272a56a23e', '0c8bdc45-e300-4a60-9389-881c9c81bbab', '664c85f2-f8ae-4030-9580-1537e3fbba8e', '32c8c976-0eba-43d3-8cb6-e21287d8f32d'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:17 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:17 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:18 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:18 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Deleted volume successfully. Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8237b268-d553-4693-9201-0a6b764d8a03 tempest-ProjectReaderTests-243094432 None] Lock "cinder-26e758c9-cc83-4983-8bdd-7e64fc879a20-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-b2bdd0df-2914-4218-9b2f-5396359fd2af-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-b2bdd0df-2914-4218-9b2f-5396359fd2af-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-b2bdd0df-2914-4218-9b2f-5396359fd2af" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-b2bdd0df-2914-4218-9b2f-5396359fd2af" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f34626-4fd9-449b-8c02-bcb256441c94]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:18 devstack sudo[113526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af Aug 24 10:13:18 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (52f88cc5-92f4-494a-a8ff-e63e506c6ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ae3f87-75c2-47cf-b104-dcf3046fb82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ae3f87-75c2-47cf-b104-dcf3046fb82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192118638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42216d-c6b8-4675-bdbe-06e78da8f185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:18Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daef366d-329c-4b74-bb93-3baa9d1670c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daef366d-329c-4b74-bb93-3baa9d1670c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133d1497-f584-495e-b8d5-8841a0f09cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133d1497-f584-495e-b8d5-8841a0f09cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb42216d-c6b8-4675-bdbe-06e78da8f185', 'volume_name': 'volume-cb42216d-c6b8-4675-bdbe-06e78da8f185', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87807753-c4c9-41e2-bf66-7ba10b260b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87807753-c4c9-41e2-bf66-7ba10b260b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ba56be-8b5f-4f4b-947e-7179cf73d7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:18 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Volume cb42216d-c6b8-4675-bdbe-06e78da8f185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb42216d-c6b8-4675-bdbe-06e78da8f185', 'volume_size': 1} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192118638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42216d-c6b8-4675-bdbe-06e78da8f185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:18Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Creating volume cb42216d-c6b8-4675-bdbe-06e78da8f185 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:18 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:18 devstack sudo[113528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 1073741824 Aug 24 10:13:18 devstack sudo[113528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:18 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:18 devstack sudo[113533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af Aug 24 10:13:18 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:19 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b2bdd0df-2914-4218-9b2f-5396359fd2af" returned: 0 in 0.400s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-b2bdd0df-2914-4218-9b2f-5396359fd2af" released by "delete_volume" :: held 0.930s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:19 devstack sudo[113528]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 1073741824" returned: 0 in 0.624s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['fe889a4d-442f-4924-92e2-f8ef804dad61', '7d118acc-7ec0-4220-90f4-814d61b0b822', '2dc3e883-982d-4fa0-8f11-36e997e83c28', '00cdc82a-9418-40a7-9da8-4eee2de89bad'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:19 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 Aug 24 10:13:19 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (e9291a46-1556-4ecc-b110-31b5a4fc66d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a601fb-7068-401d-85cb-bafbd5514b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a601fb-7068-401d-85cb-bafbd5514b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966160424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eab0689-77f5-4a57-8a2b-d68146509c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:19Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949ae40c-c341-4041-93ff-662b80f5d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (949ae40c-c341-4041-93ff-662b80f5d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2688f277-bb30-4196-8cc5-d7cea64bb35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2688f277-bb30-4196-8cc5-d7cea64bb35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eab0689-77f5-4a57-8a2b-d68146509c3f', 'volume_name': 'volume-2eab0689-77f5-4a57-8a2b-d68146509c3f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7158d55-d2d7-41a0-b5f3-8161f34b8c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7158d55-d2d7-41a0-b5f3-8161f34b8c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b241ab-ea8d-4737-bc9c-58f203dec155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume 2eab0689-77f5-4a57-8a2b-d68146509c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eab0689-77f5-4a57-8a2b-d68146509c3f', 'volume_size': 1} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:19 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:19 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:19 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Flow 'volume_create_manager' (c555cbbc-b11a-4192-8634-ad9798d64887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d69d5-eac1-4d09-8bff-48df7de15cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185" returned: 0 in 0.435s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-966160424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eab0689-77f5-4a57-8a2b-d68146509c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:19Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Creating volume 2eab0689-77f5-4a57-8a2b-d68146509c3f {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:19 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d69d5-eac1-4d09-8bff-48df7de15cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b27b125-8448-4c06-a986-73973e8e82de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7448b69d7b4e2296512a2c63e31254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:19Z,use_quota=True,user_id='af8ddecc638e4732b35d84cc2b152563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c651932-16ad-47c0-813a-8d993ca56e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c651932-16ad-47c0-813a-8d993ca56e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe0b17b-2977-4794-aacb-8e61b20a85cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe0b17b-2977-4794-aacb-8e61b20a85cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b27b125-8448-4c06-a986-73973e8e82de', 'volume_name': 'volume-4b27b125-8448-4c06-a986-73973e8e82de', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack sudo[113546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f 1073741824 Aug 24 10:13:19 devstack sudo[113546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff129fa1-de9e-4200-9b4a-3b91baede748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff129fa1-de9e-4200-9b4a-3b91baede748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964685a2-d689-43aa-bafd-dba6b8bbf7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Volume 4b27b125-8448-4c06-a986-73973e8e82de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b27b125-8448-4c06-a986-73973e8e82de', 'volume_size': 1} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (9b06fae1-0081-41a2-9fa7-2ef34ac14c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7f9d1c-7227-4dfe-bbc9-dd053cec972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ba56be-8b5f-4f4b-947e-7179cf73d7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb42216d-c6b8-4675-bdbe-06e78da8f185', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c12cf2-3841-418d-a4f6-c4116724ce92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.371s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7f9d1c-7227-4dfe-bbc9-dd053cec972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-859452502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b61c00-cdd6-4b03-90c6-1800217c7b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:20Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f68eb5a-c3c5-47d9-a34c-a12ee0f84904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f68eb5a-c3c5-47d9-a34c-a12ee0f84904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a02793-c208-4a8d-b71e-d212f310b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a02793-c208-4a8d-b71e-d212f310b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b61c00-cdd6-4b03-90c6-1800217c7b31', 'volume_name': 'volume-13b61c00-cdd6-4b03-90c6-1800217c7b31', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a723101-24c9-4f6a-9dd0-df3132ff2f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a723101-24c9-4f6a-9dd0-df3132ff2f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1645625e-76e9-46c1-9d86-28784447931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume 13b61c00-cdd6-4b03-90c6-1800217c7b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b61c00-cdd6-4b03-90c6-1800217c7b31', 'volume_size': 1} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Volume volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 (cb42216d-c6b8-4675-bdbe-06e78da8f185): created successfully Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c12cf2-3841-418d-a4f6-c4116724ce92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (52f88cc5-92f4-494a-a8ff-e63e506c6ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleted volume successfully. Aug 24 10:13:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-921b959b-fdf4-4fa0-a6fc-8b006b1a2af1 tempest-ProjectReaderTests-243094432 None] Created volume successfully. Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d5a42aa1-f285-4b56-8182-bb0bb76b9788 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-b2bdd0df-2914-4218-9b2f-5396359fd2af-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (238ec359-ef5e-4005-b1d9-a49de0f33a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe411fa-dcc8-4cab-9e55-adcfb9a80ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe411fa-dcc8-4cab-9e55-adcfb9a80ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1207146467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a83efa-b2cf-4762-878c-c4ba3d2d82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:20Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938011b6-2c28-4aea-8e4c-0ac04817659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938011b6-2c28-4aea-8e4c-0ac04817659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08b9a86-3053-488e-8b7c-15a0fb967e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack sudo[113546]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08b9a86-3053-488e-8b7c-15a0fb967e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a83efa-b2cf-4762-878c-c4ba3d2d82b4', 'volume_name': 'volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48bded8-0d62-49dd-9b19-d30f48445ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48bded8-0d62-49dd-9b19-d30f48445ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc9ca7c-0843-46c9-ab41-479dd0e0cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume 86a83efa-b2cf-4762-878c-c4ba3d2d82b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4', 'volume_size': 1} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f 1073741824" returned: 0 in 0.653s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-7950f093-7df3-42bb-8560-54176901e654-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-7950f093-7df3-42bb-8560-54176901e654-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-5f7e442e-df1e-4e00-96cb-01a51be1dcda" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:20 devstack sudo[113553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-5f7e442e-df1e-4e00-96cb-01a51be1dcda" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-7950f093-7df3-42bb-8560-54176901e654" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:20 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-7950f093-7df3-42bb-8560-54176901e654" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleting offline snapshot 7950f093-7df3-42bb-8560-54176901e654 of volume 5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] snapshot_file for this snap is: volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0736a-5fdf-464a-b432-948ba7bdc177]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-cb42216d-c6b8-4675-bdbe-06e78da8f185-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Lock "cinder-cb42216d-c6b8-4675-bdbe-06e78da8f185-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:20 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 Aug 24 10:13:20 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-quobyte-cb42216d-c6b8-4675-bdbe-06e78da8f185" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (e621a336-3fd9-4837-98be-11709b5a1985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4755e226-e773-4ceb-9db2-dc43c7435143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-cb42216d-c6b8-4675-bdbe-06e78da8f185" acquired by "delete_volume" :: waited 0.063s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:20 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b27b125-8448-4c06-a986-73973e8e82de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7448b69d7b4e2296512a2c63e31254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:19Z,use_quota=True,user_id='af8ddecc638e4732b35d84cc2b152563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Creating volume 4b27b125-8448-4c06-a986-73973e8e82de {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:20 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7323b3cb-cb1f-40ee-a7dc-973da2ded9c6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:20 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de 1073741824 Aug 24 10:13:20 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4755e226-e773-4ceb-9db2-dc43c7435143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1160716816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64464e82-e9b2-4b6d-a83f-733bad454322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:21Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9327a101-4913-4309-94a0-af553cff3231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9327a101-4913-4309-94a0-af553cff3231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36880c13-b97e-4956-bf60-a3eb99439cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36880c13-b97e-4956-bf60-a3eb99439cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64464e82-e9b2-4b6d-a83f-733bad454322', 'volume_name': 'volume-64464e82-e9b2-4b6d-a83f-733bad454322', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139306fe-f75d-440a-90d9-54519b714b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139306fe-f75d-440a-90d9-54519b714b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258f9ce6-f39a-41d2-855a-27d6f373de02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume 64464e82-e9b2-4b6d-a83f-733bad454322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64464e82-e9b2-4b6d-a83f-733bad454322', 'volume_size': 1} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b241ab-ea8d-4737-bc9c-58f203dec155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eab0689-77f5-4a57-8a2b-d68146509c3f', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fccea9c-66a8-4f57-95a1-de42f4cefa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume volume-2eab0689-77f5-4a57-8a2b-d68146509c3f (2eab0689-77f5-4a57-8a2b-d68146509c3f): created successfully Aug 24 10:13:21 devstack sudo[113559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 Aug 24 10:13:21 devstack sudo[113559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fccea9c-66a8-4f57-95a1-de42f4cefa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (e9291a46-1556-4ecc-b110-31b5a4fc66d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-aeda07f1-f4e8-4207-a777-8077514d7dde tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created volume successfully. Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (12411765-9e78-4a7a-bd8c-0e46de81ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4ae848-3ae2-43ad-8e22-357c3695a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4ae848-3ae2-43ad-8e22-357c3695a037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746421706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62720278-b341-4bff-88ee-3b9c32da383d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:21Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf4fd5c-2232-4f50-8da0-47b74db98cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf4fd5c-2232-4f50-8da0-47b74db98cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2475cb3d-b97a-4840-94ab-10b8b7cf89ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2475cb3d-b97a-4840-94ab-10b8b7cf89ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62720278-b341-4bff-88ee-3b9c32da383d', 'volume_name': 'volume-62720278-b341-4bff-88ee-3b9c32da383d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216b6c1a-90c3-4996-81df-beb3be7f5dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216b6c1a-90c3-4996-81df-beb3be7f5dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a617333-9df8-4582-8171-8cfca6f96e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume 62720278-b341-4bff-88ee-3b9c32da383d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62720278-b341-4bff-88ee-3b9c32da383d', 'volume_size': 1} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654" returned: 0 in 0.693s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b29a6-864a-4350-8280-2478f30caa4d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:21 devstack sudo[113559]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185" returned: 0 in 0.489s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:21 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de 1073741824" returned: 0 in 0.526s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:21 devstack sudo[113570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda Aug 24 10:13:21 devstack sudo[113570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:21 devstack sudo[113574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185 Aug 24 10:13:21 devstack sudo[113574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:21 devstack sudo[113577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de Aug 24 10:13:21 devstack sudo[113577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:21 devstack sudo[113574]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cb42216d-c6b8-4675-bdbe-06e78da8f185" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-cb42216d-c6b8-4675-bdbe-06e78da8f185" released by "delete_volume" :: held 0.839s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:21 devstack sudo[113570]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda" returned: 0 in 0.388s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:21 devstack sudo[113577]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de" returned: 0 in 0.260s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:21 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-859452502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b61c00-cdd6-4b03-90c6-1800217c7b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:20Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Creating volume 13b61c00-cdd6-4b03-90c6-1800217c7b31 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:21 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:21 devstack sudo[113586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 1073741824 Aug 24 10:13:21 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964685a2-d689-43aa-bafd-dba6b8bbf7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b27b125-8448-4c06-a986-73973e8e82de', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2542e72a-8d37-437b-a680-1ad76b1391d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Volume volume-4b27b125-8448-4c06-a986-73973e8e82de (4b27b125-8448-4c06-a986-73973e8e82de): created successfully Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2542e72a-8d37-437b-a680-1ad76b1391d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Flow 'volume_create_manager' (c555cbbc-b11a-4192-8634-ad9798d64887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Created reservations ['0ba99021-5b55-4636-9a0e-d7658fdd1538', 'd6da2788-d590-434a-8f3b-587be2cc6dd5', 'af1ba52f-bbd5-4572-8685-261bec4409ed', '8f5b95e7-9bff-4ca1-b83b-67552e9f5ad3'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-e8c0113b-7d89-4a68-ac0d-c65d8e24f9e3 tempest-CinderUnicodeTest-1613748840 None] Created volume successfully. Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:21 devstack sudo[113588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:21 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:22 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654" returned: 0 in 0.370s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:22 devstack sudo[113596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654 Aug 24 10:13:22 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:22 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.269s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Deleted volume successfully. Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-de08469d-9a6e-49d4-bd00-925de863596a tempest-ProjectReaderTests-243094432 None] Lock "cinder-cb42216d-c6b8-4675-bdbe-06e78da8f185-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:22 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 1073741824" returned: 0 in 0.533s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:22 devstack sudo[113600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 Aug 24 10:13:22 devstack sudo[113600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:22 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda.7950f093-7df3-42bb-8560-54176901e654" returned: 0 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-7950f093-7df3-42bb-8560-54176901e654" released by "_delete_snapshot" :: held 1.928s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-5f7e442e-df1e-4e00-96cb-01a51be1dcda" released by "delete_snapshot" :: held 1.970s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['cc153400-c1ac-4329-a28d-bf3b2ee264c9', 'a65d095b-89fd-414b-9e2c-74db8aa15b62', 'add94105-f13f-4526-b515-67bf6419e712', '85c5d51f-3aa9-4c9d-b96e-71d8b9695e03'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Delete snapshot completed successfully. Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-03e9fe6f-83a7-42bd-8cd0-f4e771e62ac2 tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-7950f093-7df3-42bb-8560-54176901e654-delete_snapshot" released by "delete_snapshot" :: held 2.158s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31" returned: 0 in 0.299s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:22 devstack sudo[113600]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1207146467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a83efa-b2cf-4762-878c-c4ba3d2d82b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:20Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Creating volume 86a83efa-b2cf-4762-878c-c4ba3d2d82b4 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:22 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:22 devstack sudo[113604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 1073741824 Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1645625e-76e9-46c1-9d86-28784447931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b61c00-cdd6-4b03-90c6-1800217c7b31', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:22 devstack sudo[113604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffc3394-03db-4e8b-8fed-e596445860aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:22 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 (13b61c00-cdd6-4b03-90c6-1800217c7b31): created successfully Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffc3394-03db-4e8b-8fed-e596445860aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (9b06fae1-0081-41a2-9fa7-2ef34ac14c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-5f7e442e-df1e-4e00-96cb-01a51be1dcda-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ac1d4fe7-8aa8-4615-86b0-8713cba178c1 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created volume successfully. Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-5f7e442e-df1e-4e00-96cb-01a51be1dcda-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "cinder-quobyte-5f7e442e-df1e-4e00-96cb-01a51be1dcda" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-5f7e442e-df1e-4e00-96cb-01a51be1dcda" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb8b68e-b2f3-4d79-b31b-5afc07aa19a2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:22 devstack sudo[113606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda Aug 24 10:13:22 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Flow 'volume_create_manager' (ae686a96-c7b3-4f94-b759-76abac225e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bc94db-0636-4c3b-ab98-a99b3be10de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bc94db-0636-4c3b-ab98-a99b3be10de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-385904681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabf9294-e4fe-47f1-b658-b7eb95b94b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7448b69d7b4e2296512a2c63e31254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:23Z,use_quota=True,user_id='af8ddecc638e4732b35d84cc2b152563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca462cae-125e-4e0a-9a74-c9eaeed9b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca462cae-125e-4e0a-9a74-c9eaeed9b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f697ebf-17fa-471d-9371-f88cc7e605c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f697ebf-17fa-471d-9371-f88cc7e605c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabf9294-e4fe-47f1-b658-b7eb95b94b92', 'volume_name': 'volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9c3eef-dc97-4e4e-b804-5c554fc1e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9c3eef-dc97-4e4e-b804-5c554fc1e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5139370e-1608-45b8-a7ed-c7c0877cfb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Volume cabf9294-e4fe-47f1-b658-b7eb95b94b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92', 'volume_size': 1} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:23 devstack sudo[113604]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 1073741824" returned: 0 in 0.574s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:23 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 Aug 24 10:13:23 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:23 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda" returned: 0 in 0.457s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:23 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda Aug 24 10:13:23 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:23 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (70baa113-fdf5-4f53-aa0d-81ae1d633a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92a83f4-b4ce-4bec-87ff-9ee3c47d81d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-5f7e442e-df1e-4e00-96cb-01a51be1dcda" returned: 0 in 0.289s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92a83f4-b4ce-4bec-87ff-9ee3c47d81d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997516586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032adc30-eb31-4592-b5bd-d64a86b02ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:24Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b7c47f-e2f0-4782-a4a6-4d60db576585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b7c47f-e2f0-4782-a4a6-4d60db576585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff7a268-5fb2-4517-a58b-4dd7dc08e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff7a268-5fb2-4517-a58b-4dd7dc08e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032adc30-eb31-4592-b5bd-d64a86b02ace', 'volume_name': 'volume-032adc30-eb31-4592-b5bd-d64a86b02ace', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab6da59-65ab-4d62-971a-833f70a697eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab6da59-65ab-4d62-971a-833f70a697eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d107a777-17a2-4fdb-b986-faf6454b6516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Volume 032adc30-eb31-4592-b5bd-d64a86b02ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032adc30-eb31-4592-b5bd-d64a86b02ace', 'volume_size': 1} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-quobyte-5f7e442e-df1e-4e00-96cb-01a51be1dcda" released by "delete_volume" :: held 0.849s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4" returned: 0 in 0.434s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1160716816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64464e82-e9b2-4b6d-a83f-733bad454322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:21Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Creating volume 64464e82-e9b2-4b6d-a83f-733bad454322 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:23 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:23 devstack sudo[113621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 1073741824 Aug 24 10:13:23 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc9ca7c-0843-46c9-ab41-479dd0e0cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6efa08-b05c-4a3a-bfa8-57d68ce627b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 (86a83efa-b2cf-4762-878c-c4ba3d2d82b4): created successfully Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6efa08-b05c-4a3a-bfa8-57d68ce627b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (238ec359-ef5e-4005-b1d9-a49de0f33a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b131f30c-7e0f-49a1-83e1-e6657bf80541 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created volume successfully. Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Created reservations ['204d6471-d51f-4d01-b076-4edc6c582ccd', '8a9c188a-759f-4953-acc9-4a934270ef4e', '7beef159-2a0f-408b-a10e-c407c7386537', '4838debe-49c2-4db0-9b31-7c3b927fd736'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:23 devstack sudo[113623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:23 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:24 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:24 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.250s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 1073741824" returned: 0 in 0.426s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Deleted volume successfully. Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-df743a97-67ec-46ad-b314-d78516ec28bb tempest-CreateVolumesFromSnapshotTest-1830339844 None] Lock "cinder-5f7e442e-df1e-4e00-96cb-01a51be1dcda-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:24 devstack sudo[113629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 Aug 24 10:13:24 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:24 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322" returned: 0 in 0.235s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.119s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746421706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62720278-b341-4bff-88ee-3b9c32da383d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5f053a058e49e0800ea5403e75faa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:21Z,use_quota=True,user_id='6fa19f7a3c0049218ba14e985fe79364',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Creating volume 62720278-b341-4bff-88ee-3b9c32da383d {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:24 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258f9ce6-f39a-41d2-855a-27d6f373de02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64464e82-e9b2-4b6d-a83f-733bad454322', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:24 devstack sudo[113632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d 1073741824 Aug 24 10:13:24 devstack sudo[113632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60852359-cf63-4e8d-946c-361ee3d558ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:24 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume volume-64464e82-e9b2-4b6d-a83f-733bad454322 (64464e82-e9b2-4b6d-a83f-733bad454322): created successfully Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60852359-cf63-4e8d-946c-361ee3d558ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (e621a336-3fd9-4837-98be-11709b5a1985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:24 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8afb7407-b3f3-4cda-9736-1a9feefc1711 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created volume successfully. Aug 24 10:13:24 devstack sudo[113632]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d 1073741824" returned: 0 in 0.431s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:24 devstack sudo[113638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d Aug 24 10:13:24 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:25 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-385904681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabf9294-e4fe-47f1-b658-b7eb95b94b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7448b69d7b4e2296512a2c63e31254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:23Z,use_quota=True,user_id='af8ddecc638e4732b35d84cc2b152563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Creating volume cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:25 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a617333-9df8-4582-8171-8cfca6f96e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62720278-b341-4bff-88ee-3b9c32da383d', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:25 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 1073741824 Aug 24 10:13:25 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef752c9-4fb3-47eb-a86b-161242d5326a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:25 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Volume volume-62720278-b341-4bff-88ee-3b9c32da383d (62720278-b341-4bff-88ee-3b9c32da383d): created successfully Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef752c9-4fb3-47eb-a86b-161242d5326a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Flow 'volume_create_manager' (12411765-9e78-4a7a-bd8c-0e46de81ec16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-69b9204f-f6cc-4157-bfc0-65fa2ccd2542 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created volume successfully. Aug 24 10:13:25 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 1073741824" returned: 0 in 0.514s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:25 devstack sudo[113646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 Aug 24 10:13:25 devstack sudo[113646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-62720278-b341-4bff-88ee-3b9c32da383d-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-62720278-b341-4bff-88ee-3b9c32da383d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-quobyte-62720278-b341-4bff-88ee-3b9c32da383d" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-62720278-b341-4bff-88ee-3b9c32da383d" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e26eac8-112c-4aef-8fad-79d19e4c64f0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:25 devstack sudo[113648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d Aug 24 10:13:25 devstack sudo[113648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:26 devstack sudo[113646]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92" returned: 0 in 0.327s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.374s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997516586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032adc30-eb31-4592-b5bd-d64a86b02ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:24Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Creating volume 032adc30-eb31-4592-b5bd-d64a86b02ace {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:26 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:26 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace 1073741824 Aug 24 10:13:26 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5139370e-1608-45b8-a7ed-c7c0877cfb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6164cb-59cb-4c3f-8488-161dc497841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:26 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Volume volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 (cabf9294-e4fe-47f1-b658-b7eb95b94b92): created successfully Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6164cb-59cb-4c3f-8488-161dc497841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Flow 'volume_create_manager' (ae686a96-c7b3-4f94-b759-76abac225e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-9891a7bd-b100-463a-9511-24164f62daf3 tempest-CinderUnicodeTest-1613748840 None] Created volume successfully. Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:26 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:26 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:26 devstack sudo[113648]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d" returned: 0 in 0.515s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:26 devstack sudo[113661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d Aug 24 10:13:26 devstack sudo[113661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:26 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:13:26 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace 1073741824" returned: 0 in 0.543s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:26 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace Aug 24 10:13:26 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:26 devstack sudo[113661]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-62720278-b341-4bff-88ee-3b9c32da383d" returned: 0 in 0.301s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-62720278-b341-4bff-88ee-3b9c32da383d" released by "delete_volume" :: held 0.862s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created reservations ['0cff237d-79c5-44ff-ab75-2af925e00845', 'ad86f482-5965-4d21-a946-a81996499d6a', '940a8fbd-3cbf-4e54-8d77-8dff50ec6b3b', 'bebebbf7-8bda-46cc-b8f4-af70508c494c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:26 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:26 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:26 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace" returned: 0 in 0.290s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d107a777-17a2-4fdb-b986-faf6454b6516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032adc30-eb31-4592-b5bd-d64a86b02ace', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf84faa-6499-4526-b395-415e93138bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:26 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Volume volume-032adc30-eb31-4592-b5bd-d64a86b02ace (032adc30-eb31-4592-b5bd-d64a86b02ace): created successfully Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf84faa-6499-4526-b395-415e93138bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (70baa113-fdf5-4f53-aa0d-81ae1d633a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-64464e82-e9b2-4b6d-a83f-733bad454322-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-64464e82-e9b2-4b6d-a83f-733bad454322-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6909e90a-18f8-40e4-896b-b9b69ffb2962 tempest-ProjectReaderTests-243094432 None] Created volume successfully. Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-quobyte-64464e82-e9b2-4b6d-a83f-733bad454322" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-64464e82-e9b2-4b6d-a83f-733bad454322" acquired by "delete_volume" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:27 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.292s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc86a1-8c4a-432a-a718-e10943ddf03c]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Deleted volume successfully. Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-ff647dd2-234a-4730-9676-8542237cd877 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-62720278-b341-4bff-88ee-3b9c32da383d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:27 devstack sudo[113672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 Aug 24 10:13:27 devstack sudo[113672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Creating offline snapshot 63b838d4-55ad-4d5b-8ea0-107217fa5015 of volume cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7adff4-cde9-4fe8-ba63-c93f5a027029]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:27 devstack sudo[113672]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322" returned: 0 in 0.441s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:27 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322 Aug 24 10:13:27 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:27 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 Aug 24 10:13:27 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:27 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-64464e82-e9b2-4b6d-a83f-733bad454322" returned: 0 in 0.274s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-64464e82-e9b2-4b6d-a83f-733bad454322" released by "delete_volume" :: held 0.764s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-032adc30-eb31-4592-b5bd-d64a86b02ace-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created reservations ['7bc49a18-a7f5-438a-921d-4ccd7060bf6e', '39981cdd-85e1-4e6e-af68-d81964b38525', 'bbd94a57-660f-4b73-a06d-5e0f4cdc0cc5', '8562aed1-07d5-4cf5-b843-28631a50c9bd'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:27 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92" returned: 0 in 0.413s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Lock "cinder-032adc30-eb31-4592-b5bd-d64a86b02ace-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:27 devstack sudo[113685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 1G Aug 24 10:13:27 devstack sudo[113685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-quobyte-032adc30-eb31-4592-b5bd-d64a86b02ace" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-032adc30-eb31-4592-b5bd-d64a86b02ace" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[485310fe-9d07-43c5-9624-29e38ba5a58d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-86a83efa-b2cf-4762-878c-c4ba3d2d82b4-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:28 devstack sudo[113688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:28 devstack sudo[113688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-86a83efa-b2cf-4762-878c-c4ba3d2d82b4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-quobyte-86a83efa-b2cf-4762-878c-c4ba3d2d82b4" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:28 devstack sudo[113687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace Aug 24 10:13:28 devstack sudo[113687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-86a83efa-b2cf-4762-878c-c4ba3d2d82b4" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a19e6-a343-4d3c-9940-c21099fba2e5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:28 devstack sudo[113693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 Aug 24 10:13:28 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack sudo[113688]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.483s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Deleted volume successfully. Aug 24 10:13:28 devstack sudo[113685]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Flow 'volume_create_manager' (218e353e-129f-493e-afd8-d5e522aa0bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:28 devstack sudo[113687]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d667e565-6a89-44c4-b526-5ee297334eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 1G" returned: 0 in 0.726s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace" returned: 0 in 0.610s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:28 devstack sudo[113701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 Aug 24 10:13:28 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dad67cd4-82fa-4931-a73d-c72f9d1d3d2a tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-64464e82-e9b2-4b6d-a83f-733bad454322-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:28 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace Aug 24 10:13:28 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d667e565-6a89-44c4-b526-5ee297334eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-931829415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152efc34-1548-4580-9bd5-15492564c867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b439aeacf54de4bf0cbbd08bfd99a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:29Z,use_quota=True,user_id='67eb9125bc5e44c19fa7653bff49e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2583e61b-051f-4d17-ad58-3ac4a567da9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2583e61b-051f-4d17-ad58-3ac4a567da9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f0bf7e-f1ad-4c72-b7aa-6aadef99980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f0bf7e-f1ad-4c72-b7aa-6aadef99980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152efc34-1548-4580-9bd5-15492564c867', 'volume_name': 'volume-152efc34-1548-4580-9bd5-15492564c867', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b0e688-2a02-4313-9a6b-df0f45efa61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b0e688-2a02-4313-9a6b-df0f45efa61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e907e3-13c0-43a3-aa4d-6b3025f0bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:28 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Volume 152efc34-1548-4580-9bd5-15492564c867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152efc34-1548-4580-9bd5-15492564c867', 'volume_size': 1} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:28 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4" returned: 0 in 0.530s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:28 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4 Aug 24 10:13:28 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:28 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-032adc30-eb31-4592-b5bd-d64a86b02ace" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-032adc30-eb31-4592-b5bd-d64a86b02ace" released by "delete_volume" :: held 0.950s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:28 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015" returned: 0 in 0.325s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 is being set with open permissions: ugo+rw Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:29 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 Aug 24 10:13:29 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Created reservations ['b1479027-85a5-4541-9e02-485e11d61a98', 'd236f095-9347-4cc5-8d92-417e8a74193b', '5ee247d3-493f-4c3e-bdc3-78eacd851527', '68284269-4595-4bf8-9688-c22ff2a48252'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:29 devstack sudo[113717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:29 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:29 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-86a83efa-b2cf-4762-878c-c4ba3d2d82b4" returned: 0 in 0.297s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-86a83efa-b2cf-4762-878c-c4ba3d2d82b4" released by "delete_volume" :: held 0.890s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created reservations ['df1406d8-537e-4e1b-91c2-963e844194d0', '3643303a-253f-4d8c-a211-2809d3f1b271', 'ab889416-448e-4baf-9bb3-82b9ad48f5d8', '42886052-6e15-4eae-b2a3-fc728a39dc5e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:29 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015" returned: 0 in 0.264s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:29 devstack sudo[113720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info Aug 24 10:13:29 devstack sudo[113720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:29 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:29 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-13b61c00-cdd6-4b03-90c6-1800217c7b31-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-13b61c00-cdd6-4b03-90c6-1800217c7b31-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:29 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.308s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Deleted volume successfully. Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-quobyte-13b61c00-cdd6-4b03-90c6-1800217c7b31" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f7d4cdd3-4b6e-4ae3-a110-8935959c86c2 tempest-ProjectReaderTests-243094432 None] Lock "cinder-032adc30-eb31-4592-b5bd-d64a86b02ace-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-13b61c00-cdd6-4b03-90c6-1800217c7b31" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1dfef-f9f7-4856-80f0-9827fc77fb46]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:29 devstack sudo[113720]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info" returned: 0 in 0.351s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info is being set with open permissions: ugo+rw Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:29 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 Aug 24 10:13:29 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:29 devstack sudo[113728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info Aug 24 10:13:29 devstack sudo[113728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:29 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.346s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Deleted volume successfully. Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-28ad8ff3-9615-4730-a2c2-04fcfbd690e2 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-86a83efa-b2cf-4762-878c-c4ba3d2d82b4-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:29 devstack sudo[113728]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.info" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:29 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-931829415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152efc34-1548-4580-9bd5-15492564c867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b439aeacf54de4bf0cbbd08bfd99a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:29Z,use_quota=True,user_id='67eb9125bc5e44c19fa7653bff49e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Creating volume 152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:29 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31" returned: 0 in 0.418s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:30 devstack sudo[113735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 1073741824 Aug 24 10:13:30 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:30 devstack sudo[113736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31 Aug 24 10:13:30 devstack sudo[113736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0d7312d9-24ad-4205-a102-0793ad59d726 tempest-CinderUnicodeTest-1613748840 None] Create snapshot completed successfully Aug 24 10:13:30 devstack sudo[113736]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-13b61c00-cdd6-4b03-90c6-1800217c7b31" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-13b61c00-cdd6-4b03-90c6-1800217c7b31" released by "delete_volume" :: held 0.729s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created reservations ['5ba2a56d-6248-4837-8777-f3e1524604d6', '9df03e2f-31f3-477f-9cbf-352900bbfefd', '3d2e3234-27e3-436b-b750-9ed2cc4119d0', '20d3bcbd-2b97-4366-a055-cd6e788d54d6'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:30 devstack sudo[113744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:30 devstack sudo[113744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:30 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 1073741824" returned: 0 in 0.493s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:30 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 Aug 24 10:13:30 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-2eab0689-77f5-4a57-8a2b-d68146509c3f-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:30 devstack sudo[113744]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-63b838d4-55ad-4d5b-8ea0-107217fa5015-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.434s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:30 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Deleted volume successfully. Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-2eab0689-77f5-4a57-8a2b-d68146509c3f-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-63b838d4-55ad-4d5b-8ea0-107217fa5015-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-quobyte-cabf9294-e4fe-47f1-b658-b7eb95b94b92" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (79c1bf3a-e3bc-47b5-9e46-d528084c4d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacd07a1-6bb5-4dfc-bc33-b0af15b7ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-fbb1864c-3aae-4713-9e9e-5ba94d7448b9 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-13b61c00-cdd6-4b03-90c6-1800217c7b31-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-cabf9294-e4fe-47f1-b658-b7eb95b94b92" acquired by "delete_snapshot" :: waited 0.062s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-quobyte-63b838d4-55ad-4d5b-8ea0-107217fa5015" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacd07a1-6bb5-4dfc-bc33-b0af15b7ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330099820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031b3f24-fa95-4434-a28b-005ba32cb3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:31Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4698d4e6-598e-4754-8ce9-37f24f927be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4698d4e6-598e-4754-8ce9-37f24f927be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63118541-e3bd-4967-82eb-4c2681b25aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63118541-e3bd-4967-82eb-4c2681b25aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '031b3f24-fa95-4434-a28b-005ba32cb3df', 'volume_name': 'volume-031b3f24-fa95-4434-a28b-005ba32cb3df', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b037a89-746d-4b7e-a50b-5333630afbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:30 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b037a89-746d-4b7e-a50b-5333630afbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2662a918-a6d4-4bf1-99d5-f5280231b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:30 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Volume 031b3f24-fa95-4434-a28b-005ba32cb3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-031b3f24-fa95-4434-a28b-005ba32cb3df', 'volume_size': 1} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-quobyte-2eab0689-77f5-4a57-8a2b-d68146509c3f" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867" returned: 0 in 0.439s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330099820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031b3f24-fa95-4434-a28b-005ba32cb3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b007fef7faee435c8cf5fbaa4f25892d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:31Z,use_quota=True,user_id='dc00935ff1d04207a17ac29bfed542a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Creating volume 031b3f24-fa95-4434-a28b-005ba32cb3df {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:30 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-63b838d4-55ad-4d5b-8ea0-107217fa5015" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:31 devstack sudo[113750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df 1073741824 Aug 24 10:13:31 devstack sudo[113750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Deleting offline snapshot 63b838d4-55ad-4d5b-8ea0-107217fa5015 of volume cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] snapshot_file for this snap is: volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-2eab0689-77f5-4a57-8a2b-d68146509c3f" acquired by "delete_volume" :: waited 0.066s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed96c2a-556f-49ad-a297-4a61b3abacee]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e907e3-13c0-43a3-aa4d-6b3025f0bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152efc34-1548-4580-9bd5-15492564c867', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b113a76-8a4b-4c26-b628-e7ac753729d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc8b448-76e9-4786-9d8a-490c7556caa0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:31 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Volume volume-152efc34-1548-4580-9bd5-15492564c867 (152efc34-1548-4580-9bd5-15492564c867): created successfully Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b113a76-8a4b-4c26-b628-e7ac753729d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Flow 'volume_create_manager' (218e353e-129f-493e-afd8-d5e522aa0bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5f191b4a-e924-45f9-bba2-7c247194cf0a tempest-VolumeDependencyTests-301562011 None] Created volume successfully. Aug 24 10:13:31 devstack sudo[113753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 Aug 24 10:13:31 devstack sudo[113753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:31 devstack sudo[113754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f Aug 24 10:13:31 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:31 devstack sudo[113750]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df 1073741824" returned: 0 in 0.456s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:31 devstack sudo[113753]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015" returned: 0 in 0.410s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:13:31 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f" returned: 0 in 0.406s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b831feb3-deb9-4163-a401-986d65df11bf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:31 devstack sudo[113766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f Aug 24 10:13:31 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:31 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df Aug 24 10:13:31 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:31 devstack sudo[113767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 Aug 24 10:13:31 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:31 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2eab0689-77f5-4a57-8a2b-d68146509c3f" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-2eab0689-77f5-4a57-8a2b-d68146509c3f" released by "delete_volume" :: held 0.755s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:31 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df" returned: 0 in 0.357s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2662a918-a6d4-4bf1-99d5-f5280231b58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031b3f24-fa95-4434-a28b-005ba32cb3df', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fdbc4b-bdd3-4f68-9612-9c460942bf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:31 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Volume volume-031b3f24-fa95-4434-a28b-005ba32cb3df (031b3f24-fa95-4434-a28b-005ba32cb3df): created successfully Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7fdbc4b-bdd3-4f68-9612-9c460942bf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Flow 'volume_create_manager' (79c1bf3a-e3bc-47b5-9e46-d528084c4d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:31 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created reservations ['8e0ec300-141d-4bf1-8ef1-4c311053b41b', 'd25e24a8-f6ff-4e94-9a47-e60986eec6af', '31a992e4-bd81-4af2-b297-cf5c941e80b8', '0b4e5c63-fa23-4a07-bede-6d4ba37d5771'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fcbfad97-28fd-427f-ade6-a03e9046b1e2 tempest-ProjectReaderTests-243094432 None] Created volume successfully. Aug 24 10:13:31 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92" returned: 0 in 0.496s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:32 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 Aug 24 10:13:32 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Creating offline snapshot a830bd1d-e985-4f26-b9ad-36ff92859640 of volume 152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d10c1a-b226-4ac6-975b-021cc983d3cd]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:32 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:32 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:32 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 Aug 24 10:13:32 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:32 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015" returned: 0 in 0.340s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:32 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015 Aug 24 10:13:32 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:32 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Deleted volume successfully. Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f86999c9-6604-4b36-a95a-1a1d9097ac60 tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-2eab0689-77f5-4a57-8a2b-d68146509c3f-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:32 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:32 devstack sudo[113792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 1G Aug 24 10:13:32 devstack sudo[113792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:32 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92.63b838d4-55ad-4d5b-8ea0-107217fa5015" returned: 0 in 0.253s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-63b838d4-55ad-4d5b-8ea0-107217fa5015" released by "_delete_snapshot" :: held 1.623s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-cabf9294-e4fe-47f1-b658-b7eb95b94b92" released by "delete_snapshot" :: held 1.720s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Created reservations ['d991b453-6798-42af-8b5a-ed9913241a0f', '3df38860-7da7-4d92-bf71-e74379689a28', '499f3948-132b-4589-abd7-f57d80377a17', '635e57f8-07a2-4a7a-82c2-6e4de9fcb10f'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:32 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Delete snapshot completed successfully. Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-efb84f9b-9668-40a3-8807-4d49e5b64d42 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-63b838d4-55ad-4d5b-8ea0-107217fa5015-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-031b3f24-fa95-4434-a28b-005ba32cb3df-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Lock "cinder-031b3f24-fa95-4434-a28b-005ba32cb3df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Acquiring lock "cinder-quobyte-031b3f24-fa95-4434-a28b-005ba32cb3df" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-031b3f24-fa95-4434-a28b-005ba32cb3df" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c542bd7-2676-4835-9c16-1de5f030f773]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-cabf9294-e4fe-47f1-b658-b7eb95b94b92-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:32 devstack sudo[113792]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 1G" returned: 0 in 0.499s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152efc34-1548-4580-9bd5-15492564c867 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-cabf9294-e4fe-47f1-b658-b7eb95b94b92-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:33 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152efc34-1548-4580-9bd5-15492564c867 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 Aug 24 10:13:33 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-6d3bbc64-9902-4969-ac88-71155d54b665-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-6d3bbc64-9902-4969-ac88-71155d54b665-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-quobyte-cabf9294-e4fe-47f1-b658-b7eb95b94b92" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:33 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df Aug 24 10:13:33 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-cabf9294-e4fe-47f1-b658-b7eb95b94b92" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06694b-b1ba-4839-b73a-bcac01b33b8b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "cinder-quobyte-6d3bbc64-9902-4969-ac88-71155d54b665" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-6d3bbc64-9902-4969-ac88-71155d54b665" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60158be7-6047-478c-b653-079784dc331b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 Aug 24 10:13:33 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 Aug 24 10:13:33 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152efc34-1548-4580-9bd5-15492564c867 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640" returned: 0 in 0.415s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 is being set with open permissions: ugo+rw Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df" returned: 0 in 0.461s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 Aug 24 10:13:33 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df Aug 24 10:13:33 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack sudo[113821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92 Aug 24 10:13:33 devstack sudo[113821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665" returned: 0 in 0.446s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640" returned: 0 in 0.320s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-031b3f24-fa95-4434-a28b-005ba32cb3df" returned: 0 in 0.313s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack sudo[113828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665 Aug 24 10:13:33 devstack sudo[113828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Lock "cinder-quobyte-031b3f24-fa95-4434-a28b-005ba32cb3df" released by "delete_volume" :: held 0.853s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:33 devstack sudo[113830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info Aug 24 10:13:33 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Created reservations ['93641d01-f988-4541-8268-e981a657a01f', 'b06585f9-1022-41db-a0d9-574ae31bf642', '9b562f93-d4ba-47a0-9bcc-ae64690def93', '2363e428-7a95-4878-98dc-d24a000fc776'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:33 devstack sudo[113821]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-cabf9294-e4fe-47f1-b658-b7eb95b94b92" returned: 0 in 0.313s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-cabf9294-e4fe-47f1-b658-b7eb95b94b92" released by "delete_volume" :: held 0.838s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:34 devstack sudo[113828]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:34 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:34 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6d3bbc64-9902-4969-ac88-71155d54b665" returned: 0 in 0.331s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Created reservations ['a4f7cbdb-5bf9-4d25-a02e-f3914b738b69', 'd6c136fd-bc33-4d7d-8e30-4eb968ad4d3b', '34642c3f-ce20-4a30-ab7f-128309a590fa', 'f7a8b1b3-77b8-4ff7-8d6b-133c7c64bb01'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-quobyte-6d3bbc64-9902-4969-ac88-71155d54b665" released by "delete_volume" :: held 0.850s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:34 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info" returned: 0 in 0.363s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:34 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info is being set with open permissions: ugo+rw Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:34 devstack sudo[113837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info Aug 24 10:13:34 devstack sudo[113837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:34 devstack sudo[113839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:34 devstack sudo[113839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Created reservations ['17c99a71-b748-4168-b7fe-2c940367135e', '1f55f1c7-3146-4ae0-b25c-ffc1d1932145', '29c4c0f0-84bf-4eda-8474-1805703b2f48', 'b635f91d-e9af-4f49-a70e-a1a72f8fda69'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:34 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:34 devstack sudo[113842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.468s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:34 devstack sudo[113842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Deleted volume successfully. Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a3a58c85-a0c9-4a7d-a2ca-6506cb898142 tempest-ProjectReaderTests-243094432 None] Lock "cinder-031b3f24-fa95-4434-a28b-005ba32cb3df-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:34 devstack sudo[113839]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.332s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Deleted volume successfully. Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0562cece-e498-4dda-aa0b-849e2daa8e12 tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-cabf9294-e4fe-47f1-b658-b7eb95b94b92-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:34 devstack sudo[113837]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.info" returned: 0 in 0.428s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-88aec952-6b69-4662-8fd1-da4b56eec463 tempest-VolumeDependencyTests-301562011 None] Create snapshot completed successfully Aug 24 10:13:34 devstack sudo[113842]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.315s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Deleted volume successfully. Aug 24 10:13:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-449fa7c9-dd90-410b-af87-4994b400d89b tempest-CreateVolumesFromSourceVolumeTest-1820256232 None] Lock "cinder-6d3bbc64-9902-4969-ac88-71155d54b665-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-4b27b125-8448-4c06-a986-73973e8e82de-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-4b27b125-8448-4c06-a986-73973e8e82de-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "cinder-quobyte-4b27b125-8448-4c06-a986-73973e8e82de" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-4b27b125-8448-4c06-a986-73973e8e82de" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1dba8b-1da4-41a6-b025-21bd4fa71481]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:35 devstack sudo[113847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de Aug 24 10:13:35 devstack sudo[113847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:35 devstack sudo[113847]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de" returned: 0 in 0.525s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Flow 'volume_create_manager' (0d6b4a13-93dc-4345-b73b-a881edf8b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:35 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de Aug 24 10:13:35 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:35 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3b14ca-c091-4f0b-985a-696d9c33f38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3b14ca-c091-4f0b-985a-696d9c33f38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-189348920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f85e070-fbab-4222-866e-bec3ecb74045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b439aeacf54de4bf0cbbd08bfd99a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a830bd1d-e985-4f26-b9ad-36ff92859640,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:36Z,use_quota=True,user_id='67eb9125bc5e44c19fa7653bff49e622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cb8d36-3398-4508-a46b-ea6e82e32c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cb8d36-3398-4508-a46b-ea6e82e32c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb0464f-7df1-4680-9a2f-c51500a00703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb0464f-7df1-4680-9a2f-c51500a00703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f85e070-fbab-4222-866e-bec3ecb74045', 'volume_name': 'volume-2f85e070-fbab-4222-866e-bec3ecb74045', 'volume_size': 1, 'snapshot_id': 'a830bd1d-e985-4f26-b9ad-36ff92859640'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aadea5a6-48c9-4746-a129-c07fcf591c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aadea5a6-48c9-4746-a129-c07fcf591c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31e9bc8-8cf9-48eb-a168-9905458dc8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:36 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Volume 2f85e070-fbab-4222-866e-bec3ecb74045: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f85e070-fbab-4222-866e-bec3ecb74045', 'volume_size': 1, 'snapshot_id': 'a830bd1d-e985-4f26-b9ad-36ff92859640'} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-quobyte-a830bd1d-e985-4f26-b9ad-36ff92859640-2f85e070-fbab-4222-866e-bec3ecb74045" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-a830bd1d-e985-4f26-b9ad-36ff92859640-2f85e070-fbab-4222-866e-bec3ecb74045" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Creating volume 2f85e070-fbab-4222-866e-bec3ecb74045 from snapshot a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-quobyte-2f85e070-fbab-4222-866e-bec3ecb74045" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-2f85e070-fbab-4222-866e-bec3ecb74045" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] snapshot: a830bd1d-e985-4f26-b9ad-36ff92859640, volume: 2f85e070-fbab-4222-866e-bec3ecb74045, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1997f-72b6-49fe-bf2f-58870fc6b8a9]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:36 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-4b27b125-8448-4c06-a986-73973e8e82de" returned: 0 in 0.422s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-quobyte-4b27b125-8448-4c06-a986-73973e8e82de" released by "delete_volume" :: held 1.004s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Created reservations ['6dbd7cb9-85ea-444f-b8b5-650b5486a004', '0c594475-9638-4eb3-8166-7a6647c04705', '8c5ad519-2831-4b20-b1ec-c566ea70add8', '0839d0bc-6556-41e2-8683-20bfde548393'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:36 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 Aug 24 10:13:36 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:36 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:36 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:36 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:36 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:36 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Deleted volume successfully. Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640" returned: 0 in 0.638s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152efc34-1548-4580-9bd5-15492564c867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce45a547-2e5e-45aa-be54-edd1d2242f8e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-d8e39b37-41c4-41da-9bfd-bb3343a1a9ca tempest-CinderUnicodeTest-1613748840 None] Lock "cinder-4b27b125-8448-4c06-a986-73973e8e82de-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:37 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 Aug 24 10:13:37 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:37 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867" returned: 0 in 0.402s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:13:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:13:37 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:13:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:37 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 Aug 24 10:13:37 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:42 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045" returned: 0 in 5.537s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:13:42 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Converted 1024.00 MB image at 184.90 MB/s Aug 24 10:13:42 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 is being set with open permissions: ugo+rw Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:42 devstack sudo[113928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 Aug 24 10:13:42 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (6a821bc6-6d3d-4fc2-9b8f-c656251c28ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3c88fc-2aab-4311-b900-3c958339aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3c88fc-2aab-4311-b900-3c958339aebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160248671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194c52d1-75a2-4635-9632-b55a7e46a5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:43Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741c567d-8248-45aa-89c6-ad0d4eb25c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:42 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741c567d-8248-45aa-89c6-ad0d4eb25c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e2d3c0-9ed4-4361-a49f-639e0b38b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e2d3c0-9ed4-4361-a49f-639e0b38b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194c52d1-75a2-4635-9632-b55a7e46a5b2', 'volume_name': 'volume-194c52d1-75a2-4635-9632-b55a7e46a5b2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00d539d-509b-41cc-a761-cb310d660de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00d539d-509b-41cc-a761-cb310d660de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08109e16-64a2-4cfb-b1eb-ee8e609669dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Volume 194c52d1-75a2-4635-9632-b55a7e46a5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194c52d1-75a2-4635-9632-b55a7e46a5b2', 'volume_size': 1} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:43 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045" returned: 0 in 0.256s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-2f85e070-fbab-4222-866e-bec3ecb74045" released by "_copy_volume_from_snapshot" :: held 7.000s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-a830bd1d-e985-4f26-b9ad-36ff92859640-2f85e070-fbab-4222-866e-bec3ecb74045" released by "_create_volume_from_snapshot" :: held 7.098s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.126s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-160248671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194c52d1-75a2-4635-9632-b55a7e46a5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:43Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Creating volume 194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:43 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:43 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 1073741824 Aug 24 10:13:43 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31e9bc8-8cf9-48eb-a168-9905458dc8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f85e070-fbab-4222-866e-bec3ecb74045', 'volume_size': 1, 'snapshot_id': 'a830bd1d-e985-4f26-b9ad-36ff92859640'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767b17e0-71ff-4c8f-92f1-e56475cead71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Volume volume-2f85e070-fbab-4222-866e-bec3ecb74045 (2f85e070-fbab-4222-866e-bec3ecb74045): created successfully Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767b17e0-71ff-4c8f-92f1-e56475cead71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Flow 'volume_create_manager' (0d6b4a13-93dc-4345-b73b-a881edf8b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2ad41a2d-360d-470a-8e4a-7087fdd019e5 tempest-VolumeDependencyTests-301562011 None] Created volume successfully. Aug 24 10:13:43 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 1073741824" returned: 0 in 0.443s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:43 devstack sudo[113937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 Aug 24 10:13:43 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:43 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2" returned: 0 in 0.250s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08109e16-64a2-4cfb-b1eb-ee8e609669dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194c52d1-75a2-4635-9632-b55a7e46a5b2', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338225d9-c447-4167-923d-b1aa11f81709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:43 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Volume volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 (194c52d1-75a2-4635-9632-b55a7e46a5b2): created successfully Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338225d9-c447-4167-923d-b1aa11f81709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:43 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (6a821bc6-6d3d-4fc2-9b8f-c656251c28ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-a830bd1d-e985-4f26-b9ad-36ff92859640-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f547682e-ec9e-4dc9-b957-78cd47e81a64 tempest-ProjectReaderTests-150164153 None] Created volume successfully. Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Lock "cinder-a830bd1d-e985-4f26-b9ad-36ff92859640-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-quobyte-152efc34-1548-4580-9bd5-15492564c867" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-152efc34-1548-4580-9bd5-15492564c867" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-quobyte-a830bd1d-e985-4f26-b9ad-36ff92859640" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-a830bd1d-e985-4f26-b9ad-36ff92859640" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Deleting offline snapshot a830bd1d-e985-4f26-b9ad-36ff92859640 of volume 152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] snapshot_file for this snap is: volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7977c04-a76c-4664-b623-e99a39d23cde]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:44 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 Aug 24 10:13:44 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:44 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640" returned: 0 in 0.386s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152efc34-1548-4580-9bd5-15492564c867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5485e8-2ec4-4128-8876-16c1653e41ab]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:44 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 Aug 24 10:13:44 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:45 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867" returned: 0 in 0.617s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Creating offline snapshot 5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 of volume 194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:13:45 devstack sudo[113950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 Aug 24 10:13:45 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8790f21-ac94-4b85-9f1f-a4cedafad8c5]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:45 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 Aug 24 10:13:45 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:45 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640" returned: 0 in 0.371s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:45 devstack sudo[113958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640 Aug 24 10:13:45 devstack sudo[113958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:45 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2" returned: 0 in 0.416s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:45 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 1G Aug 24 10:13:45 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:45 devstack sudo[113958]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867.a830bd1d-e985-4f26-b9ad-36ff92859640" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-a830bd1d-e985-4f26-b9ad-36ff92859640" released by "_delete_snapshot" :: held 1.782s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-152efc34-1548-4580-9bd5-15492564c867" released by "delete_snapshot" :: held 1.806s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Created reservations ['82a7fcca-6c02-4f58-9a7f-a7a5d4f39eda', '34f1f114-8439-460f-8c1d-64f3f61b2611', 'f5c44351-2458-4488-9ad8-cb0d76c2115a', '21a33f93-3cec-4d27-8f1d-b831f5fbc0c0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:45 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Delete snapshot completed successfully. Aug 24 10:13:45 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-6e9705e7-c133-404a-8b83-8e4b4be2da4c tempest-VolumeDependencyTests-301562011 None] Lock "cinder-a830bd1d-e985-4f26-b9ad-36ff92859640-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:46 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 1G" returned: 0 in 0.479s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:46 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 Aug 24 10:13:46 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-152efc34-1548-4580-9bd5-15492564c867-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Lock "cinder-152efc34-1548-4580-9bd5-15492564c867-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-quobyte-152efc34-1548-4580-9bd5-15492564c867" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-152efc34-1548-4580-9bd5-15492564c867" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64aa50f-fb89-4a43-918a-092eb1b8dee2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:46 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:46 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 is being set with open permissions: ugo+rw Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:46 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 Aug 24 10:13:46 devstack sudo[113975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 Aug 24 10:13:46 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:46 devstack sudo[113975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:46 devstack sudo[113975]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" returned: 0 in 0.264s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:46 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867" returned: 0 in 0.409s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:46 devstack sudo[113982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info Aug 24 10:13:46 devstack sudo[113982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:46 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867 Aug 24 10:13:46 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:47 devstack sudo[113982]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info" returned: 0 in 0.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:47 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:47 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info is being set with open permissions: ugo+rw Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-152efc34-1548-4580-9bd5-15492564c867" returned: 0 in 0.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:47 devstack sudo[113988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info Aug 24 10:13:47 devstack sudo[113988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-152efc34-1548-4580-9bd5-15492564c867" released by "delete_volume" :: held 0.768s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Created reservations ['eb5f5d41-34f0-4cab-8cda-710cdba3050f', '856e49fd-2e4e-4020-8e35-c3cef7b21ff0', '70623922-9471-404f-ab27-db8337d1ff0f', '5f51ff88-dd32-4ec1-8250-1c86bcb1acfb'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:47 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:47 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:47 devstack sudo[113988]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.info" returned: 0 in 0.331s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:47 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-97379ada-03a9-4bcd-a4c1-f39388324d9f tempest-ProjectReaderTests-150164153 None] Create snapshot completed successfully Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-2f85e070-fbab-4222-866e-bec3ecb74045-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-2f85e070-fbab-4222-866e-bec3ecb74045-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "cinder-quobyte-2f85e070-fbab-4222-866e-bec3ecb74045" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:47 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.282s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-2f85e070-fbab-4222-866e-bec3ecb74045" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:47 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Deleted volume successfully. Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7714120-cc38-4f35-9047-66d879029cc0]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8811b7ca-b25f-4329-a922-c7717264a74f tempest-VolumeDependencyTests-301562011 None] Lock "cinder-152efc34-1548-4580-9bd5-15492564c867-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:47 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 Aug 24 10:13:47 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:47 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045" returned: 0 in 0.372s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:47 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045 Aug 24 10:13:47 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:48 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-2f85e070-fbab-4222-866e-bec3ecb74045" returned: 0 in 0.265s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-quobyte-2f85e070-fbab-4222-866e-bec3ecb74045" released by "delete_volume" :: held 0.686s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Created reservations ['c58cf624-ee3d-4fce-bc96-31c9f9dca5ca', 'ca764ca4-9016-44b0-a1d7-93fd41a8a716', '33e80277-b244-4c05-ab8e-3ea3a7d416f3', '620b392d-b0d6-4ef3-8900-b11933fa1f8e'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:48 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:48 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Lock "cinder-5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-194c52d1-75a2-4635-9632-b55a7e46a5b2" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-194c52d1-75a2-4635-9632-b55a7e46a5b2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Deleting offline snapshot 5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 of volume 194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] snapshot_file for this snap is: volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7fcff8-61c5-4f5a-bf4a-a0ac41f719b2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:48 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:48 devstack sudo[114004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 Aug 24 10:13:48 devstack sudo[114004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Deleted volume successfully. Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-b444fedd-326b-418f-bda4-a757efce1198 tempest-VolumeDependencyTests-301562011 None] Lock "cinder-2f85e070-fbab-4222-866e-bec3ecb74045-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:48 devstack sudo[114004]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" returned: 0 in 0.399s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-194c52d1-75a2-4635-9632-b55a7e46a5b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a054f-7a31-49c6-b193-9ffa6eb57657]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:49 devstack sudo[114010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 Aug 24 10:13:49 devstack sudo[114010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:49 devstack sudo[114010]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2" returned: 0 in 0.380s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:49 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 Aug 24 10:13:49 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:49 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" returned: 0 in 0.421s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:49 devstack sudo[114020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52 Aug 24 10:13:49 devstack sudo[114020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:50 devstack sudo[114020]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2.5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52" released by "_delete_snapshot" :: held 1.595s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-194c52d1-75a2-4635-9632-b55a7e46a5b2" released by "delete_snapshot" :: held 1.621s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Created reservations ['8c0249dd-b9ee-418a-913e-12de6ced27ce', 'a9476073-7297-4517-a717-70c1f80a540a', '29afff11-6681-4ffe-931f-5b9151e31e09', '1ada3a36-1f35-4a24-bee4-9e0e5457dfe3'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:50 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Delete snapshot completed successfully. Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-227f0c14-9b42-4897-91d1-958e96443c1b tempest-ProjectReaderTests-150164153 None] Lock "cinder-5ed1f2bd-6a67-4021-89a8-7dd8c42f1a52-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-194c52d1-75a2-4635-9632-b55a7e46a5b2-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Lock "cinder-194c52d1-75a2-4635-9632-b55a7e46a5b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-194c52d1-75a2-4635-9632-b55a7e46a5b2" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-194c52d1-75a2-4635-9632-b55a7e46a5b2" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a4f796-ae10-4551-98aa-2d1693b51b5b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:50 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 Aug 24 10:13:50 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:51 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2" returned: 0 in 0.383s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:51 devstack sudo[114029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2 Aug 24 10:13:51 devstack sudo[114029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:51 devstack sudo[114029]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-194c52d1-75a2-4635-9632-b55a7e46a5b2" returned: 0 in 0.266s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-194c52d1-75a2-4635-9632-b55a7e46a5b2" released by "delete_volume" :: held 0.711s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Created reservations ['2871d551-6802-4e54-bb02-03e225f078c2', '8c93befc-21b1-49e0-b5ac-c482458a9b49', '092c64c9-ff8b-488e-bee6-ac43634a0df1', '4e349437-e871-4500-aa9e-aa6ad1fa84be'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:51 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:13:51 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:51 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.286s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:13:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Deleted volume successfully. Aug 24 10:13:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-54ed2e2a-d3a6-4c81-b2e1-72e7d903fe3b tempest-ProjectReaderTests-150164153 None] Lock "cinder-194c52d1-75a2-4635-9632-b55a7e46a5b2-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (15df8aa1-3724-41a9-8824-688f8fede1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa346ed1-43cd-44bd-bdea-0087dabcc489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa346ed1-43cd-44bd-bdea-0087dabcc489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1554502145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dfc893-1d6d-4668-9358-b41c4133a356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:52Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66c8b0-3760-4984-b835-0b500942076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66c8b0-3760-4984-b835-0b500942076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7f3030-ba46-4e24-8216-53b7bc33c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7f3030-ba46-4e24-8216-53b7bc33c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8dfc893-1d6d-4668-9358-b41c4133a356', 'volume_name': 'volume-f8dfc893-1d6d-4668-9358-b41c4133a356', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a8a562-8e32-4180-a43b-04d97815c721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a8a562-8e32-4180-a43b-04d97815c721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fe2914-2e8c-4edb-afbf-096a96785317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:52 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Volume f8dfc893-1d6d-4668-9358-b41c4133a356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8dfc893-1d6d-4668-9358-b41c4133a356', 'volume_size': 1} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1554502145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8dfc893-1d6d-4668-9358-b41c4133a356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:52Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Creating volume f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:52 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:52 devstack sudo[114035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 1073741824 Aug 24 10:13:52 devstack sudo[114035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:52 devstack sudo[114035]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 1073741824" returned: 0 in 0.459s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:53 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 Aug 24 10:13:53 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:53 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356" returned: 0 in 0.245s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fe2914-2e8c-4edb-afbf-096a96785317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8dfc893-1d6d-4668-9358-b41c4133a356', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b83267-321a-4262-8db3-8ee66104cd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:53 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Volume volume-f8dfc893-1d6d-4668-9358-b41c4133a356 (f8dfc893-1d6d-4668-9358-b41c4133a356): created successfully Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b83267-321a-4262-8db3-8ee66104cd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (15df8aa1-3724-41a9-8824-688f8fede1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fd4dea52-95e6-461d-a218-e1699b17990d tempest-ProjectReaderTests-150164153 None] Created volume successfully. Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Flow 'volume_create_manager' (b4b65f88-a20b-4f90-a6f9-f57f90cbf18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de40643-fc62-4417-85bf-ec3f5bd803ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de40643-fc62-4417-85bf-ec3f5bd803ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c803bb5-9492-4b30-86d7-961785e78b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d1930986df4eaebf6383843c00fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:54Z,use_quota=True,user_id='25b89541649a4e5493463e78fccf1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63897b6-fa12-4104-94e5-7bc5682e6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63897b6-fa12-4104-94e5-7bc5682e6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08713f76-012d-42f5-b39b-5e1be8105d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.image.glance [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Creating Keystone auth plugin from conf {{(pid=94039) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Creating offline snapshot 76da01a9-f8bf-417f-b4db-0ef08ae67baf of volume f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7056e589-f4cb-44b7-a9f2-e20a17f84c04]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:54 devstack sudo[114044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 Aug 24 10:13:54 devstack sudo[114044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08713f76-012d-42f5-b39b-5e1be8105d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c803bb5-9492-4b30-86d7-961785e78b36', 'volume_name': 'volume-8c803bb5-9492-4b30-86d7-961785e78b36', 'volume_size': 1, 'image_id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69d0654c788f2a2d11450b28930ca9c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4d1930986df4eaebf6383843c00fd76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '341495539e80c441c29ff2d236708baed0616063d565dd0c42d0fdd99d3e76bfe7be8d19bcfea075ee5a1ebcc18ad3061ed530869771cf9cc5f37f4023f7ced7', 'id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'created_at': datetime.datetime(2026, 8, 24, 8, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14/file', 'properties': {}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e525f18-e0a3-4d95-acb7-365f7c080b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e525f18-e0a3-4d95-acb7-365f7c080b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c217047-d60c-4b8f-b043-9edccfcc6620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:13:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Volume 8c803bb5-9492-4b30-86d7-961785e78b36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c803bb5-9492-4b30-86d7-961785e78b36', 'volume_size': 1, 'image_id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69d0654c788f2a2d11450b28930ca9c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4d1930986df4eaebf6383843c00fd76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '341495539e80c441c29ff2d236708baed0616063d565dd0c42d0fdd99d3e76bfe7be8d19bcfea075ee5a1ebcc18ad3061ed530869771cf9cc5f37f4023f7ced7', 'id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'created_at': datetime.datetime(2026, 8, 24, 8, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14/file', 'properties': {}}, 'image_service': } Aug 24 10:13:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Trying to clone 8c803bb5-9492-4b30-86d7-961785e78b36 from image eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'metadata': {}}]). {{(pid=94039) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 24 10:13:55 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Image download 0.00 MB at 0.00 MB/s Aug 24 10:13:55 devstack sudo[114044]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356" returned: 0 in 0.435s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:55 devstack sudo[114050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf 1G Aug 24 10:13:55 devstack sudo[114050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a6c4a3-6b08-470a-8b4f-93a84e3a466e]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:55 devstack sudo[114052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD Aug 24 10:13:55 devstack sudo[114052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:55 devstack sudo[114052]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:55 devstack sudo[114050]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf 1G" returned: 0 in 0.476s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8dfc893-1d6d-4668-9358-b41c4133a356 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:55 devstack sudo[114061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8dfc893-1d6d-4668-9358-b41c4133a356 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf Aug 24 10:13:55 devstack sudo[114061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:55 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD Aug 24 10:13:55 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:55 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Temporary image eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 is fetched for user 25b89541649a4e5493463e78fccf1b16. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 24 10:13:55 devstack sudo[114061]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8dfc893-1d6d-4668-9358-b41c4133a356 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf" returned: 0 in 0.329s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:55 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf is being set with open permissions: ugo+rw Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:55 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf Aug 24 10:13:55 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a058ba02-abab-443a-aeff-7506984764ac]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:56 devstack sudo[114072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD Aug 24 10:13:56 devstack sudo[114072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:56 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:56 devstack sudo[114076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info Aug 24 10:13:56 devstack sudo[114076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:56 devstack sudo[114072]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:56 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD Aug 24 10:13:56 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:56 devstack sudo[114076]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info" returned: 0 in 0.296s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:56 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info is being set with open permissions: ugo+rw Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:56 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info Aug 24 10:13:56 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:56 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:56 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.info" returned: 0 in 0.268s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.186s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c803bb5-9492-4b30-86d7-961785e78b36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d1930986df4eaebf6383843c00fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:13:54Z,use_quota=True,user_id='25b89541649a4e5493463e78fccf1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Creating volume 8c803bb5-9492-4b30-86d7-961785e78b36 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:13:56 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=345,cinder:SELECT=239,cinder:DELETE=25,cinder:INSERT=83 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:13:56 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 1073741824 Aug 24 10:13:56 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:56 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=236,cinder:UPDATE=319,cinder:INSERT=85,cinder:DELETE=34 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:13:56 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-38b85c13-633b-468e-982f-ee04c694894f tempest-ProjectReaderTests-150164153 None] Create snapshot completed successfully Aug 24 10:13:57 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 1073741824" returned: 0 in 0.438s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:57 devstack sudo[114095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 Aug 24 10:13:57 devstack sudo[114095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:57 devstack sudo[114095]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36" returned: 0 in 0.242s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Attempting download of eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'metadata': {}}])) to volume 8c803bb5-9492-4b30-86d7-961785e78b36. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702a37c-fcef-4c3c-a9b8-1a4498847e7c]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:57 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d Aug 24 10:13:57 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-76da01a9-f8bf-417f-b4db-0ef08ae67baf-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Lock "cinder-76da01a9-f8bf-417f-b4db-0ef08ae67baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-f8dfc893-1d6d-4668-9358-b41c4133a356" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-f8dfc893-1d6d-4668-9358-b41c4133a356" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-76da01a9-f8bf-417f-b4db-0ef08ae67baf" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-76da01a9-f8bf-417f-b4db-0ef08ae67baf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Deleting offline snapshot 76da01a9-f8bf-417f-b4db-0ef08ae67baf of volume f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] snapshot_file for this snap is: volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c8684-13d9-4597-b50e-ef8d469065ee]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:57 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:58 devstack sudo[114100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf Aug 24 10:13:58 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:58 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d Aug 24 10:13:58 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:58 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf" returned: 0 in 0.395s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8dfc893-1d6d-4668-9358-b41c4133a356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[61adb4c2-efb0-4ff7-9f4e-172218bd043d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:58 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d" returned: 1 in 0.358s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14_mqk3s01d' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8c549c-2584-476b-99a4-087459316a8f]: (4, 'raw') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:58 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 Aug 24 10:13:58 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:58 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD Aug 24 10:13:58 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:58 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356" returned: 0 in 0.356s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:58 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:58 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf Aug 24 10:13:58 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:58 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD Aug 24 10:13:58 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:58 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf" returned: 0 in 0.327s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:59 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 was raw, converting to qcow2 {{(pid=94039) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:59 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf Aug 24 10:13:59 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:59 devstack sudo[114134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 Aug 24 10:13:59 devstack sudo[114134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:59 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356.76da01a9-f8bf-417f-b4db-0ef08ae67baf" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-76da01a9-f8bf-417f-b4db-0ef08ae67baf" released by "_delete_snapshot" :: held 1.482s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-f8dfc893-1d6d-4668-9358-b41c4133a356" released by "delete_snapshot" :: held 1.513s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Created reservations ['4c66e639-68c3-4201-a501-1a77920643cf', 'a660e824-f7e9-420f-aeec-2889ccbab31d', '1e2f8206-5bd0-442b-8988-864aa68ff676', '9e971aa1-6f47-498a-86d5-23cafd76b742'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:13:59 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Delete snapshot completed successfully. Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8748a81e-6074-4c92-946d-550f76b59a75 tempest-ProjectReaderTests-150164153 None] Lock "cinder-76da01a9-f8bf-417f-b4db-0ef08ae67baf-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:13:59 devstack sudo[114134]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36" returned: 0 in 0.560s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eb78d7e4-eb62-41f8-bf78-ad69dcffcd14__iue2rywdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:13:59 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Converted 0.00 MB image at 0.00 MB/s Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:13:59 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 1G Aug 24 10:13:59 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-f8dfc893-1d6d-4668-9358-b41c4133a356-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Lock "cinder-f8dfc893-1d6d-4668-9358-b41c4133a356-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:13:59 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 1G" returned: 0 in 0.418s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Downloaded image eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 ((None, [{'url': 'file:///opt/stack/data/glance/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'metadata': {}}])) to volume 8c803bb5-9492-4b30-86d7-961785e78b36 successfully. {{(pid=94039) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Temporary image eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 for user 25b89541649a4e5493463e78fccf1b16 is deleted. {{(pid=94039) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 24 10:13:59 devstack cinder-volume[94039]: DEBUG cinder.volume.volume_utils [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Marking volume 8c803bb5-9492-4b30-86d7-961785e78b36 as bootable. {{(pid=94039) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-f8dfc893-1d6d-4668-9358-b41c4133a356" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Copying metadata from image eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 to 8c803bb5-9492-4b30-86d7-961785e78b36. {{(pid=94039) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Creating volume glance metadata for volume 8c803bb5-9492-4b30-86d7-961785e78b36 backed by image eb78d7e4-eb62-41f8-bf78-ad69dcffcd14 with: {'image_id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '69d0654c788f2a2d11450b28930ca9c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94039) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-f8dfc893-1d6d-4668-9358-b41c4133a356" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987107b-96a6-42fc-a94a-a25f26261257]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c217047-d60c-4b8f-b043-9edccfcc6620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c803bb5-9492-4b30-86d7-961785e78b36', 'volume_size': 1, 'image_id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '69d0654c788f2a2d11450b28930ca9c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd4d1930986df4eaebf6383843c00fd76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '341495539e80c441c29ff2d236708baed0616063d565dd0c42d0fdd99d3e76bfe7be8d19bcfea075ee5a1ebcc18ad3061ed530869771cf9cc5f37f4023f7ced7', 'id': 'eb78d7e4-eb62-41f8-bf78-ad69dcffcd14', 'created_at': datetime.datetime(2026, 8, 24, 8, 13, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 24, 8, 13, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eb78d7e4-eb62-41f8-bf78-ad69dcffcd14/file', 'properties': {}}, 'image_service': }' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4ad770-2e99-49e7-819e-d82e78567ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:00 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Volume volume-8c803bb5-9492-4b30-86d7-961785e78b36 (8c803bb5-9492-4b30-86d7-961785e78b36): created successfully Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4ad770-2e99-49e7-819e-d82e78567ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Flow 'volume_create_manager' (b4b65f88-a20b-4f90-a6f9-f57f90cbf18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:00 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-eaadca7a-3662-4a7e-bfa9-7e8aa3b8f5a2 tempest-VolumeImageDependencyTests-531077320 None] Created volume successfully. Aug 24 10:14:00 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 Aug 24 10:14:00 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:00 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356" returned: 0 in 0.350s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:00 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356 Aug 24 10:14:00 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:00 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-f8dfc893-1d6d-4668-9358-b41c4133a356" returned: 0 in 0.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-f8dfc893-1d6d-4668-9358-b41c4133a356" released by "delete_volume" :: held 0.667s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Acquiring lock "cinder-8c803bb5-9492-4b30-86d7-961785e78b36-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Lock "cinder-8c803bb5-9492-4b30-86d7-961785e78b36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Created reservations ['5d2bf066-57d7-46e9-a06f-806a9710831c', '41b76065-39c2-4737-a0b1-9dd42960b4ab', '4b332e58-d14d-48ed-a51a-3ef30329e224', 'a33152d0-8a7f-430e-a99b-3d18b6f94c00'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Acquiring lock "cinder-quobyte-8c803bb5-9492-4b30-86d7-961785e78b36" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Lock "cinder-quobyte-8c803bb5-9492-4b30-86d7-961785e78b36" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[60733c29-cd92-4cec-8220-ebae6b4d7c6a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:00 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:00 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:00 devstack sudo[114154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 Aug 24 10:14:00 devstack sudo[114154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:01 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.282s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:01 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Deleted volume successfully. Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-02c28578-4749-4505-97c3-83f6d64412f1 tempest-ProjectReaderTests-150164153 None] Lock "cinder-f8dfc893-1d6d-4668-9358-b41c4133a356-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:01 devstack sudo[114154]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36" returned: 0 in 0.432s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:01 devstack sudo[114163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36 Aug 24 10:14:01 devstack sudo[114163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:01 devstack sudo[114163]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-8c803bb5-9492-4b30-86d7-961785e78b36" returned: 0 in 0.270s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Lock "cinder-quobyte-8c803bb5-9492-4b30-86d7-961785e78b36" released by "delete_volume" :: held 0.753s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Created reservations ['3c87a8cc-9067-4130-8382-f2d3a0364264', 'c29b2d17-67d4-49f6-b90b-f87d0c604821', '0aeca595-3679-48dd-bb70-9160793597f2', '1071f6c2-cdec-4949-b880-ce0a84e57018'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (df2d3f30-12bb-47f3-b3ff-009c6a477412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a7a522-8175-43a6-9114-09bfbfc0bbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a7a522-8175-43a6-9114-09bfbfc0bbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758679435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02dbda2-3025-4cc4-a886-2d7422681ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:02Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9cb2410-2045-4240-8dc1-65f366812d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:01 devstack sudo[114166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:01 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9cb2410-2045-4240-8dc1-65f366812d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa7359f-94ad-47fe-849d-3b7e05dfe1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa7359f-94ad-47fe-849d-3b7e05dfe1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02dbda2-3025-4cc4-a886-2d7422681ce4', 'volume_name': 'volume-a02dbda2-3025-4cc4-a886-2d7422681ce4', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e351fc-cb94-4a79-8409-fbec1609a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e351fc-cb94-4a79-8409-fbec1609a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a664c180-6879-4521-a47e-25d4f99922aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:01 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Volume a02dbda2-3025-4cc4-a886-2d7422681ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02dbda2-3025-4cc4-a886-2d7422681ce4', 'volume_size': 1} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758679435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a02dbda2-3025-4cc4-a886-2d7422681ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:02Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Creating volume a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:01 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:01 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 1073741824 Aug 24 10:14:01 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:02 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.350s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Deleted volume successfully. Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2a1d3007-388c-46a1-8eba-4ae5f6b390eb tempest-VolumeImageDependencyTests-531077320 None] Lock "cinder-8c803bb5-9492-4b30-86d7-961785e78b36-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:02 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 1073741824" returned: 0 in 0.532s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:02 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 Aug 24 10:14:02 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:02 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a664c180-6879-4521-a47e-25d4f99922aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02dbda2-3025-4cc4-a886-2d7422681ce4', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cea431b-624b-4548-9876-8ef7b08ef20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:02 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Volume volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 (a02dbda2-3025-4cc4-a886-2d7422681ce4): created successfully Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cea431b-624b-4548-9876-8ef7b08ef20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:02 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (df2d3f30-12bb-47f3-b3ff-009c6a477412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4ef363e3-f860-4a38-9bcf-e1bf2dce2ff2 tempest-ProjectReaderTests-150164153 None] Created volume successfully. Aug 24 10:14:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:03 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Creating offline snapshot 39c2a29c-895a-4765-8bdc-fcecc7b95cea of volume a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:04 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c08c9-da83-425d-a5ed-c7e0054bbf69]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:04 devstack sudo[114180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 Aug 24 10:14:04 devstack sudo[114180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:04 devstack sudo[114180]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4" returned: 0 in 0.397s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:04 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea 1G Aug 24 10:14:04 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:04 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea 1G" returned: 0 in 0.434s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:04 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea Aug 24 10:14:04 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:05 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea" returned: 0 in 0.322s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:05 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea is being set with open permissions: ugo+rw Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:05 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea Aug 24 10:14:05 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:05 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-d7ed0ebf-405a-428e-a490-7bb20c8f084c tempest-ProjectAdminTests-1007060912 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1266860961914, 'free_capacity_gb': 1775.1266860961914, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94039) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 24 10:14:05 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info Aug 24 10:14:05 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:05 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info" returned: 0 in 0.284s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:05 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info is being set with open permissions: ugo+rw Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:05 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info Aug 24 10:14:05 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Flow 'volume_create_manager' (e3e47ea9-074f-4f2a-8bde-734813e96c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402fc728-3707-4240-9c65-58a1aaf58507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402fc728-3707-4240-9c65-58a1aaf58507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963714147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9552ba61-5e6f-47f6-9c3c-ce77361bd204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc09aba9df7477d810baf4440b1eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:06Z,use_quota=True,user_id='e5cf481338e2418293f0b6411454e183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb1c2a8-26a7-4798-b4e5-5f202fb821df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb1c2a8-26a7-4798-b4e5-5f202fb821df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83418d3-ac95-45b8-85b7-e3f249bccff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83418d3-ac95-45b8-85b7-e3f249bccff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9552ba61-5e6f-47f6-9c3c-ce77361bd204', 'volume_name': 'volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb39e8e4-a8ac-4ea4-81f3-e14eba069aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb39e8e4-a8ac-4ea4-81f3-e14eba069aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5813a207-70aa-4a07-ab17-765272ab344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Volume 9552ba61-5e6f-47f6-9c3c-ce77361bd204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204', 'volume_size': 1} Aug 24 10:14:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:06 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.info" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-963714147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9552ba61-5e6f-47f6-9c3c-ce77361bd204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc09aba9df7477d810baf4440b1eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:06Z,use_quota=True,user_id='e5cf481338e2418293f0b6411454e183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Creating volume 9552ba61-5e6f-47f6-9c3c-ce77361bd204 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:06 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 1073741824 Aug 24 10:14:06 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8c748210-b0e5-4d5c-9467-323d252ddc97 tempest-ProjectReaderTests-150164153 None] Create snapshot completed successfully Aug 24 10:14:06 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 1073741824" returned: 0 in 0.434s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:06 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 Aug 24 10:14:06 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:06 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5813a207-70aa-4a07-ab17-765272ab344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529be717-e23f-4174-8bc1-780b5d87a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Volume volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 (9552ba61-5e6f-47f6-9c3c-ce77361bd204): created successfully Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529be717-e23f-4174-8bc1-780b5d87a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Flow 'volume_create_manager' (e3e47ea9-074f-4f2a-8bde-734813e96c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:06 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4a3940b2-00ed-45c5-8915-cf8c137430ec tempest-ProjectReaderTests-1737227616 None] Created volume successfully. Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-39c2a29c-895a-4765-8bdc-fcecc7b95cea-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Lock "cinder-39c2a29c-895a-4765-8bdc-fcecc7b95cea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-a02dbda2-3025-4cc4-a886-2d7422681ce4" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-a02dbda2-3025-4cc4-a886-2d7422681ce4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-39c2a29c-895a-4765-8bdc-fcecc7b95cea" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-39c2a29c-895a-4765-8bdc-fcecc7b95cea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Deleting offline snapshot 39c2a29c-895a-4765-8bdc-fcecc7b95cea of volume a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] snapshot_file for this snap is: volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf8aca-003e-4a4f-9b7c-57b5aa0ac518]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:07 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea Aug 24 10:14:07 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:07 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea" returned: 0 in 0.350s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a02dbda2-3025-4cc4-a886-2d7422681ce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e60a15a-26f2-488d-9eea-1e001c6f6d49]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:07 devstack sudo[114221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 Aug 24 10:14:07 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:08 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4" returned: 0 in 0.388s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:08 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea Aug 24 10:14:08 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Acquiring lock "cinder-9552ba61-5e6f-47f6-9c3c-ce77361bd204-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Lock "cinder-9552ba61-5e6f-47f6-9c3c-ce77361bd204-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Acquiring lock "cinder-quobyte-9552ba61-5e6f-47f6-9c3c-ce77361bd204" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Lock "cinder-quobyte-9552ba61-5e6f-47f6-9c3c-ce77361bd204" acquired by "delete_volume" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1089046-28e8-4f28-8783-5e330f21fb62]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:08 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea" returned: 0 in 0.392s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:08 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea Aug 24 10:14:08 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:08 devstack sudo[114232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 Aug 24 10:14:08 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:08 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4.39c2a29c-895a-4765-8bdc-fcecc7b95cea" returned: 0 in 0.277s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-39c2a29c-895a-4765-8bdc-fcecc7b95cea" released by "_delete_snapshot" :: held 1.512s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-a02dbda2-3025-4cc4-a886-2d7422681ce4" released by "delete_snapshot" :: held 1.538s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:08 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:08 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204 Aug 24 10:14:08 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Created reservations ['5e974b62-3b58-458a-8b4a-7fb74c425673', 'fa9d563a-5b2e-4b38-b136-6b8c6d813e2b', '9800ce5c-f7eb-4f91-8311-68976bf2e3da', 'ce83a18b-29f7-45fb-9f73-9afe8c8e8175'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Delete snapshot completed successfully. Aug 24 10:14:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f710ac01-a4a3-4f21-9aa0-d6ba8ad2bdef tempest-ProjectReaderTests-150164153 None] Lock "cinder-39c2a29c-895a-4765-8bdc-fcecc7b95cea-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:08 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9552ba61-5e6f-47f6-9c3c-ce77361bd204" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Lock "cinder-quobyte-9552ba61-5e6f-47f6-9c3c-ce77361bd204" released by "delete_volume" :: held 0.709s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Created reservations ['a30422d0-c500-4186-b633-d4c278797d05', 'ce93e68b-3e5e-49cd-9634-28a894bf0ae3', '93218363-5e32-4cb7-8e43-df7e914a5e12', 'd4426124-aa56-47ad-8565-57cfc3109413'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:09 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:09 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-a02dbda2-3025-4cc4-a886-2d7422681ce4-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Lock "cinder-a02dbda2-3025-4cc4-a886-2d7422681ce4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-a02dbda2-3025-4cc4-a886-2d7422681ce4" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-a02dbda2-3025-4cc4-a886-2d7422681ce4" acquired by "delete_volume" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:09 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.393s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Deleted volume successfully. Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b0daab-2233-4a5b-9e6e-efb374277df6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-22fb9f2f-c169-48cc-ac5b-d22957440a04 tempest-ProjectReaderTests-1737227616 None] Lock "cinder-9552ba61-5e6f-47f6-9c3c-ce77361bd204-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (994f743b-bff5-4a1b-a6b6-37058ee0bb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ab8c8c-3deb-4ca1-a98b-cf7dc78ced28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:09 devstack sudo[114246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 Aug 24 10:14:09 devstack sudo[114246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ab8c8c-3deb-4ca1-a98b-cf7dc78ced28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857636086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03af8bc-72c7-41be-8626-3ced3e2284c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:10Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c7c983-a4c2-40fa-8ad8-a351efbf88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c7c983-a4c2-40fa-8ad8-a351efbf88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace3d1a7-a97c-4737-8188-33da615642e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace3d1a7-a97c-4737-8188-33da615642e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03af8bc-72c7-41be-8626-3ced3e2284c5', 'volume_name': 'volume-a03af8bc-72c7-41be-8626-3ced3e2284c5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c72b96-c8f1-4446-921b-ed41a6b2cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c72b96-c8f1-4446-921b-ed41a6b2cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e748b1f-1bf6-49f3-96d5-28208922974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:09 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Volume a03af8bc-72c7-41be-8626-3ced3e2284c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03af8bc-72c7-41be-8626-3ced3e2284c5', 'volume_size': 1} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857636086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03af8bc-72c7-41be-8626-3ced3e2284c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:10Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Creating volume a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:09 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:09 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 1073741824 Aug 24 10:14:09 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:09 devstack sudo[114246]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4" returned: 0 in 0.454s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:10 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4 Aug 24 10:14:10 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Flow 'volume_create_manager' (356e553e-42e2-4765-aaca-79cc792a863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49d131f-4c4f-48bf-b6bd-e5dbf516a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49d131f-4c4f-48bf-b6bd-e5dbf516a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302418137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75a73fb-06c2-4f84-b7b1-59e598abba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc09aba9df7477d810baf4440b1eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:10Z,use_quota=True,user_id='e5cf481338e2418293f0b6411454e183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11abb213-ee3e-467f-98ce-54712404535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11abb213-ee3e-467f-98ce-54712404535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2578a163-f2b8-4a71-b8e1-ffc1bca18692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2578a163-f2b8-4a71-b8e1-ffc1bca18692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75a73fb-06c2-4f84-b7b1-59e598abba04', 'volume_name': 'volume-b75a73fb-06c2-4f84-b7b1-59e598abba04', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d1ccfc-8192-418c-97b3-c51eca6dd63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d1ccfc-8192-418c-97b3-c51eca6dd63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b788a89a-0ea4-4908-b65b-5304e3edd4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Volume b75a73fb-06c2-4f84-b7b1-59e598abba04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75a73fb-06c2-4f84-b7b1-59e598abba04', 'volume_size': 1} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:10 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 1073741824" returned: 0 in 0.450s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:10 devstack sudo[114261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 Aug 24 10:14:10 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:10 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a02dbda2-3025-4cc4-a886-2d7422681ce4" returned: 0 in 0.290s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-a02dbda2-3025-4cc4-a886-2d7422681ce4" released by "delete_volume" :: held 0.829s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Created reservations ['b8422ca9-54b4-4f9d-a70c-d231479aa646', 'db064ab5-6fcd-4fa6-b49d-87e8f6c7c808', '9bb3436c-f1f2-448e-a7fc-2bacf727e706', 'd14ef7f3-4391-4dd0-a942-3548cb6178a0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:10 devstack sudo[114263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:10 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:10 devstack sudo[114261]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5" returned: 0 in 0.259s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302418137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75a73fb-06c2-4f84-b7b1-59e598abba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc09aba9df7477d810baf4440b1eb54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:10Z,use_quota=True,user_id='e5cf481338e2418293f0b6411454e183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Creating volume b75a73fb-06c2-4f84-b7b1-59e598abba04 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:10 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:10 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 1073741824 Aug 24 10:14:10 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e748b1f-1bf6-49f3-96d5-28208922974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03af8bc-72c7-41be-8626-3ced3e2284c5', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f057aa2-7f0b-46b0-a858-494520fad4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:10 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Volume volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 (a03af8bc-72c7-41be-8626-3ced3e2284c5): created successfully Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f057aa2-7f0b-46b0-a858-494520fad4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (994f743b-bff5-4a1b-a6b6-37058ee0bb31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c2fce762-65cb-4645-a4eb-cc1311a21bd4 tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:14:10 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.279s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Deleted volume successfully. Aug 24 10:14:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f00e26b1-7542-4f44-8afc-88aac45800b3 tempest-ProjectReaderTests-150164153 None] Lock "cinder-a02dbda2-3025-4cc4-a886-2d7422681ce4-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:11 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 1073741824" returned: 0 in 0.503s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:11 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 Aug 24 10:14:11 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (db97587a-3eb2-4d36-af7f-d4b2dafe6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea21e3d-0d39-4e4e-968c-b0884db3bede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea21e3d-0d39-4e4e-968c-b0884db3bede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270446706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ff5209-b8bc-4ad9-957d-f762ab5bc8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:11Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7a721e-fe47-4021-9d7d-b47961f61cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7a721e-fe47-4021-9d7d-b47961f61cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a227091-242c-4ea4-865f-3802dc0eeb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a227091-242c-4ea4-865f-3802dc0eeb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ff5209-b8bc-4ad9-957d-f762ab5bc8ec', 'volume_name': 'volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09573af0-98fd-4c66-a7f0-83bce08d103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09573af0-98fd-4c66-a7f0-83bce08d103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b263f19-11e2-4230-8339-b38fcf7b0ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Volume 71ff5209-b8bc-4ad9-957d-f762ab5bc8ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec', 'volume_size': 1} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:11 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04" returned: 0 in 0.247s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.111s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270446706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ff5209-b8bc-4ad9-957d-f762ab5bc8ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:11Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Creating volume 71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:11 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b788a89a-0ea4-4908-b65b-5304e3edd4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75a73fb-06c2-4f84-b7b1-59e598abba04', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec020fd2-cc48-4ed2-9148-6366d992dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:11 devstack sudo[114277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec 1073741824 Aug 24 10:14:11 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:11 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Volume volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 (b75a73fb-06c2-4f84-b7b1-59e598abba04): created successfully Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec020fd2-cc48-4ed2-9148-6366d992dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Flow 'volume_create_manager' (356e553e-42e2-4765-aaca-79cc792a863c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f820bfee-6f17-4c03-80e7-d1e1c4bd4646 tempest-ProjectReaderTests-1737227616 None] Created volume successfully. Aug 24 10:14:11 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec 1073741824" returned: 0 in 0.424s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:11 devstack sudo[114283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec Aug 24 10:14:11 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:12 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b263f19-11e2-4230-8339-b38fcf7b0ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4ba8ce-7bcc-454a-8c1c-ab83456edc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:12 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Volume volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec (71ff5209-b8bc-4ad9-957d-f762ab5bc8ec): created successfully Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4ba8ce-7bcc-454a-8c1c-ab83456edc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (db97587a-3eb2-4d36-af7f-d4b2dafe6f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot 22a987c7-f014-45fd-a3a2-15ea19b41e65 of volume a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:12 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-dbbf7d3c-e640-4a5c-9293-108f449cf2cf tempest-ProjectReaderTests-150164153 None] Created volume successfully. Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e180461e-9bd2-4778-93e1-9e5ce5ea621a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Acquiring lock "cinder-b75a73fb-06c2-4f84-b7b1-59e598abba04-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Lock "cinder-b75a73fb-06c2-4f84-b7b1-59e598abba04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Acquiring lock "cinder-quobyte-b75a73fb-06c2-4f84-b7b1-59e598abba04" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Lock "cinder-quobyte-b75a73fb-06c2-4f84-b7b1-59e598abba04" acquired by "delete_volume" :: waited 0.015s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[974063b6-acee-4cde-9779-25c04530701f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:12 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 Aug 24 10:14:12 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:12 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 Aug 24 10:14:12 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:12 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5" returned: 0 in 0.401s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:12 devstack sudo[114293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 1G Aug 24 10:14:12 devstack sudo[114293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:12 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04" returned: 0 in 0.372s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:12 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04 Aug 24 10:14:12 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:12 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-b75a73fb-06c2-4f84-b7b1-59e598abba04" returned: 0 in 0.261s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Lock "cinder-quobyte-b75a73fb-06c2-4f84-b7b1-59e598abba04" released by "delete_volume" :: held 0.668s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Created reservations ['e9bfc53b-8d8b-4c00-b36f-0b8c7b591833', '51bb815f-233e-4c1c-9a0d-8d630e8d43e7', '9d2137c5-b418-437c-b0af-a57786d25a95', '17e9261d-53d1-4d36-8158-319379077264'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:12 devstack sudo[114293]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 1G" returned: 0 in 0.412s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:12 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 Aug 24 10:14:12 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:13 devstack sudo[114308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:13 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:13 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:13 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.289s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:13 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 is being set with open permissions: ugo+rw Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Deleted volume successfully. Aug 24 10:14:13 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 Aug 24 10:14:13 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-802cd832-3c75-4c69-ae89-965806392c1a tempest-ProjectReaderTests-1737227616 None] Lock "cinder-b75a73fb-06c2-4f84-b7b1-59e598abba04-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:13 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65" returned: 0 in 0.273s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:13 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info Aug 24 10:14:13 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:13 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info" returned: 0 in 0.282s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:13 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info is being set with open permissions: ugo+rw Aug 24 10:14:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:13 devstack sudo[114322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info Aug 24 10:14:13 devstack sudo[114322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:14 devstack sudo[114322]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.info" returned: 0 in 0.254s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Creating offline snapshot 52a26da0-ee22-45c7-b47d-34a8dcdb208e of volume 71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-ddf21d6a-f765-4892-988e-6e90410b2c1d tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8523cc44-a666-4c4d-8e02-6abf3b5cc087]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:14 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec Aug 24 10:14:14 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:14 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" returned: 0 in 0.392s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:14 devstack sudo[114330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e 1G Aug 24 10:14:14 devstack sudo[114330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:15 devstack sudo[114330]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e 1G" returned: 0 in 0.417s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:15 devstack sudo[114336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e Aug 24 10:14:15 devstack sudo[114336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-22a987c7-f014-45fd-a3a2-15ea19b41e65-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-22a987c7-f014-45fd-a3a2-15ea19b41e65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-a03af8bc-72c7-41be-8626-3ced3e2284c5" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-a03af8bc-72c7-41be-8626-3ced3e2284c5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-22a987c7-f014-45fd-a3a2-15ea19b41e65" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-22a987c7-f014-45fd-a3a2-15ea19b41e65" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot 22a987c7-f014-45fd-a3a2-15ea19b41e65 of volume a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ee1ab-c9fc-498f-a5d9-ef8f28fcbb20]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:15 devstack sudo[114336]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:15 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e is being set with open permissions: ugo+rw Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:15 devstack sudo[114343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e Aug 24 10:14:15 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:15 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 Aug 24 10:14:15 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:15 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e" returned: 0 in 0.299s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:15 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65" returned: 0 in 0.415s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03af8bc-72c7-41be-8626-3ced3e2284c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41cd9fd-ec9e-4338-b597-73cb16abbe9b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:15 devstack sudo[114350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info Aug 24 10:14:15 devstack sudo[114350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:15 devstack sudo[114351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 Aug 24 10:14:15 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:16 devstack sudo[114350]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:16 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info is being set with open permissions: ugo+rw Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:16 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info Aug 24 10:14:16 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:16 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5" returned: 0 in 0.396s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:16 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 Aug 24 10:14:16 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:16 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.info" returned: 0 in 0.279s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:16 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4bb3b2b8-c529-4f4a-b074-e14c889d2d07 tempest-ProjectReaderTests-150164153 None] Create snapshot completed successfully Aug 24 10:14:16 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65" returned: 0 in 0.374s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-52a26da0-ee22-45c7-b47d-34a8dcdb208e-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:16 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65 Aug 24 10:14:16 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Lock "cinder-52a26da0-ee22-45c7-b47d-34a8dcdb208e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-52a26da0-ee22-45c7-b47d-34a8dcdb208e" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-52a26da0-ee22-45c7-b47d-34a8dcdb208e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Deleting offline snapshot 52a26da0-ee22-45c7-b47d-34a8dcdb208e of volume 71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] snapshot_file for this snap is: volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60cff0-f0ba-49a4-909a-517536bc26bf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:16 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e Aug 24 10:14:16 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:16 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5.22a987c7-f014-45fd-a3a2-15ea19b41e65" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-22a987c7-f014-45fd-a3a2-15ea19b41e65" released by "_delete_snapshot" :: held 1.614s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-a03af8bc-72c7-41be-8626-3ced3e2284c5" released by "delete_snapshot" :: held 1.648s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:16 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Created reservations ['1a4d388a-0bf1-430b-84b9-72986aa197f0', '4fe8cbd1-3be3-4e6a-ae42-452ec40f2261', '7ed1bcc1-a1cc-4b31-b1a0-4333d4a4612a', 'f08d5e6b-8b02-4e90-951c-de106ce0b031'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-78fb47e3-6511-4d0c-b3a3-a6a0f3a58c7e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-22a987c7-f014-45fd-a3a2-15ea19b41e65-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:17 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e" returned: 0 in 0.407s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[6161325a-c4b5-4b4d-bf83-ea83f492069b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:17 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec Aug 24 10:14:17 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-a03af8bc-72c7-41be-8626-3ced3e2284c5-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Lock "cinder-a03af8bc-72c7-41be-8626-3ced3e2284c5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-a03af8bc-72c7-41be-8626-3ced3e2284c5" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-a03af8bc-72c7-41be-8626-3ced3e2284c5" acquired by "delete_volume" :: waited 0.030s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f1773e-17d4-45a0-aa14-4f3a07483a09]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:17 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" returned: 0 in 0.441s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:17 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e Aug 24 10:14:17 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:17 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 Aug 24 10:14:17 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:17 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:17 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5" returned: 0 in 0.423s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:17 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e Aug 24 10:14:17 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:17 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5 Aug 24 10:14:17 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:18 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec.52a26da0-ee22-45c7-b47d-34a8dcdb208e" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:18 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a03af8bc-72c7-41be-8626-3ced3e2284c5" returned: 0 in 0.277s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-52a26da0-ee22-45c7-b47d-34a8dcdb208e" released by "_delete_snapshot" :: held 1.609s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" released by "delete_snapshot" :: held 1.634s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-a03af8bc-72c7-41be-8626-3ced3e2284c5" released by "delete_volume" :: held 0.780s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Created reservations ['ebb2433a-6581-42ad-b4fb-2b6cc2af9554', '3fa6602d-7887-42f4-b864-6a1b7949dd3c', '48617a67-20e3-4df5-8da8-b7f63ab01a52', 'fcae0763-2edd-4e13-999d-94d035bf5381'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Created reservations ['16c8a8bb-83cd-423c-82e2-7d7d9602982d', '4bc333e4-691c-4b9f-a7d1-2d07f465567b', '29bbfae5-948d-4d62-8ff3-e085c591406b', '59af7810-4234-4379-a8ee-aad6a67b1b82'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:18 devstack sudo[114396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:18 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:18 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Delete snapshot completed successfully. Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-dee85eb5-8aaa-495c-b806-bf8e03a80d97 tempest-ProjectReaderTests-150164153 None] Lock "cinder-52a26da0-ee22-45c7-b47d-34a8dcdb208e-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:18 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.277s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:18 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-8dd6d356-42ab-418b-8ff5-ea8ca9248b8b tempest-ProjectMemberTests-1824643926 None] Lock "cinder-a03af8bc-72c7-41be-8626-3ced3e2284c5-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Lock "cinder-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b5342-69a4-4f47-9658-6d1e70b28c6f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:18 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:19 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec Aug 24 10:14:19 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (f2373608-ab68-48bf-bc41-719a48c45a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b7eb5a-93b0-40c5-8962-ef99932857d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b7eb5a-93b0-40c5-8962-ef99932857d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361964283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50c038-b860-4fc9-b2ba-8f851700b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:19Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26276f2f-7369-4042-ab7a-efe90013fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26276f2f-7369-4042-ab7a-efe90013fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070b4f15-89a4-46ae-a8fe-573453e3bdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070b4f15-89a4-46ae-a8fe-573453e3bdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a50c038-b860-4fc9-b2ba-8f851700b9d1', 'volume_name': 'volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e857c741-75f9-48bf-a5f7-96ba1705235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e857c741-75f9-48bf-a5f7-96ba1705235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24c0b21-004b-4824-95a7-6f7853c1d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:19 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Volume 9a50c038-b860-4fc9-b2ba-8f851700b9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1', 'volume_size': 1} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-361964283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50c038-b860-4fc9-b2ba-8f851700b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:19Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Creating volume 9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:19 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:19 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 1073741824 Aug 24 10:14:19 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:19 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" returned: 0 in 0.415s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:19 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec Aug 24 10:14:19 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:19 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" returned: 0 in 0.299s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec" released by "delete_volume" :: held 0.808s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:19 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 1073741824" returned: 0 in 0.487s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:19 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 Aug 24 10:14:19 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Created reservations ['475b2b83-0f83-4902-b44d-3447dcf12815', '0da7eeaf-8df8-49dc-a324-ab777cb0c2b3', '880f426c-2fcd-4032-a902-e7f744fa4c8d', 'fc27a152-ca3d-48a6-8e82-7f071b038778'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:19 devstack sudo[114415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:19 devstack sudo[114415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:20 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1" returned: 0 in 0.373s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24c0b21-004b-4824-95a7-6f7853c1d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161d1260-db9d-4fec-aad6-348cdfe6db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:20 devstack sudo[114415]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Volume volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 (9a50c038-b860-4fc9-b2ba-8f851700b9d1): created successfully Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161d1260-db9d-4fec-aad6-348cdfe6db0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (f2373608-ab68-48bf-bc41-719a48c45a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.318s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Deleted volume successfully. Aug 24 10:14:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-bfae517e-1c0f-4454-9ce9-e61f2af043c9 tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a8375375-fe1b-4459-84ef-ea5cdfb3bdf5 tempest-ProjectReaderTests-150164153 None] Lock "cinder-71ff5209-b8bc-4ad9-957d-f762ab5bc8ec-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (f57840bf-d49b-4856-9b85-03097a318a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0eeaad9-ed4f-4637-8191-f4ab09bd5372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0eeaad9-ed4f-4637-8191-f4ab09bd5372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947280115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efe29b3-572f-4842-a149-2b7c826eb718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:20Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b105d1-4e7d-47bb-ab88-3490a0aa8629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b105d1-4e7d-47bb-ab88-3490a0aa8629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3fee7a-9b15-4830-8e6f-2bb825a4efc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3fee7a-9b15-4830-8e6f-2bb825a4efc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0efe29b3-572f-4842-a149-2b7c826eb718', 'volume_name': 'volume-0efe29b3-572f-4842-a149-2b7c826eb718', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2796dc-1f82-4c01-a9be-c251a8c2648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2796dc-1f82-4c01-a9be-c251a8c2648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266fc898-4beb-433f-90b1-106de97dbc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:20 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Volume 0efe29b3-572f-4842-a149-2b7c826eb718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0efe29b3-572f-4842-a149-2b7c826eb718', 'volume_size': 1} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1947280115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0efe29b3-572f-4842-a149-2b7c826eb718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8ae3410b0c4ee49979474ea7e295f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:20Z,use_quota=True,user_id='0509c65097504b75ab6727fd9fff4cad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Creating volume 0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:20 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:20 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 1073741824 Aug 24 10:14:20 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:21 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 1073741824" returned: 0 in 0.477s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:21 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 Aug 24 10:14:21 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:21 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718" returned: 0 in 0.319s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.023s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266fc898-4beb-433f-90b1-106de97dbc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0efe29b3-572f-4842-a149-2b7c826eb718', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549f6145-dfd7-40fa-8ad4-986bba050fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot 1846066d-9f94-46a7-8023-bdf39508b01b of volume 9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:21 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Volume volume-0efe29b3-572f-4842-a149-2b7c826eb718 (0efe29b3-572f-4842-a149-2b7c826eb718): created successfully Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549f6145-dfd7-40fa-8ad4-986bba050fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Flow 'volume_create_manager' (f57840bf-d49b-4856-9b85-03097a318a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[115a57b6-2f1b-4ac4-b0fa-32c83ee5592d]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:21 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-27931390-efa4-4630-8de9-009dc021f3ae tempest-ProjectReaderTests-150164153 None] Created volume successfully. Aug 24 10:14:21 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 Aug 24 10:14:21 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:21 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1" returned: 0 in 0.364s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:21 devstack sudo[114435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b 1G Aug 24 10:14:21 devstack sudo[114435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:22 devstack sudo[114435]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b 1G" returned: 0 in 0.403s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:22 devstack sudo[114441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b Aug 24 10:14:22 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:22 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b" returned: 0 in 0.324s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:22 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b is being set with open permissions: ugo+rw Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:22 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b Aug 24 10:14:22 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:22 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b" returned: 0 in 0.274s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:22 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info Aug 24 10:14:22 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:23 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info" returned: 0 in 0.249s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:23 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info is being set with open permissions: ugo+rw Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:23 devstack sudo[114453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info Aug 24 10:14:23 devstack sudo[114453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:23 devstack sudo[114453]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.info" returned: 0 in 0.250s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Creating offline snapshot d159c4b8-ed09-4753-9121-aa1859af1819 of volume 0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9060450-a874-4266-a96d-b247a9f15e00]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1c917c13-ec18-4db7-851c-459ab4299a44 tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:14:23 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 Aug 24 10:14:23 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:23 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718" returned: 0 in 0.373s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:23 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 1G Aug 24 10:14:23 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:24 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 1G" returned: 0 in 0.423s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efe29b3-572f-4842-a149-2b7c826eb718 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:24 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efe29b3-572f-4842-a149-2b7c826eb718 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 Aug 24 10:14:24 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-1846066d-9f94-46a7-8023-bdf39508b01b-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-1846066d-9f94-46a7-8023-bdf39508b01b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-9a50c038-b860-4fc9-b2ba-8f851700b9d1" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9a50c038-b860-4fc9-b2ba-8f851700b9d1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-1846066d-9f94-46a7-8023-bdf39508b01b" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-1846066d-9f94-46a7-8023-bdf39508b01b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot 1846066d-9f94-46a7-8023-bdf39508b01b of volume 9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:24 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0efe29b3-572f-4842-a149-2b7c826eb718 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:24 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 is being set with open permissions: ugo+rw Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[79910b44-147e-420b-a193-625fa4564917]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:24 devstack sudo[114472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 Aug 24 10:14:24 devstack sudo[114472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:24 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b Aug 24 10:14:24 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:25 devstack sudo[114472]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819" returned: 0 in 0.316s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:25 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info Aug 24 10:14:25 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:25 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b" returned: 0 in 0.396s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de2e1c6-b061-49af-8320-18c805f6d1cf]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:25 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 Aug 24 10:14:25 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:25 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:25 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info is being set with open permissions: ugo+rw Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:25 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info Aug 24 10:14:25 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:25 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1" returned: 0 in 0.371s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:25 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b Aug 24 10:14:25 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:25 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.info" returned: 0 in 0.244s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7a35b954-1382-44bc-bd84-24abf1461422 tempest-ProjectReaderTests-150164153 None] Create snapshot completed successfully Aug 24 10:14:25 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b" returned: 0 in 0.337s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:25 devstack sudo[114496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b Aug 24 10:14:25 devstack sudo[114496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:25 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-d159c4b8-ed09-4753-9121-aa1859af1819-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Lock "cinder-d159c4b8-ed09-4753-9121-aa1859af1819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-0efe29b3-572f-4842-a149-2b7c826eb718" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-0efe29b3-572f-4842-a149-2b7c826eb718" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-d159c4b8-ed09-4753-9121-aa1859af1819" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-d159c4b8-ed09-4753-9121-aa1859af1819" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Deleting offline snapshot d159c4b8-ed09-4753-9121-aa1859af1819 of volume 0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] snapshot_file for this snap is: volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb28475-c070-4f66-93be-9315fdf00b9a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:26 devstack sudo[114496]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1.1846066d-9f94-46a7-8023-bdf39508b01b" returned: 0 in 0.269s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-1846066d-9f94-46a7-8023-bdf39508b01b" released by "_delete_snapshot" :: held 1.502s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9a50c038-b860-4fc9-b2ba-8f851700b9d1" released by "delete_snapshot" :: held 1.531s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:26 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 Aug 24 10:14:26 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:26 devstack sudo[114501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:26 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Created reservations ['22b3b60b-3f49-489a-b55f-821db60c26be', '034c6d09-4a7d-44f5-b39a-6cacc7112e58', 'ac661eba-f221-4dcc-bf80-9faf86ca91fe', '67727348-deb9-43dc-aac8-7f07cfdfde85'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:26 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5d3b5e9d-2e8f-4c3a-8114-25b552e89167 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-1846066d-9f94-46a7-8023-bdf39508b01b-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:26 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:26 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.260s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819" returned: 0 in 0.418s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0efe29b3-572f-4842-a149-2b7c826eb718(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[451dd0d2-06e2-4b88-90cf-75ae6879eafd]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:26 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 Aug 24 10:14:26 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-9a50c038-b860-4fc9-b2ba-8f851700b9d1-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Lock "cinder-9a50c038-b860-4fc9-b2ba-8f851700b9d1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-9a50c038-b860-4fc9-b2ba-8f851700b9d1" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9a50c038-b860-4fc9-b2ba-8f851700b9d1" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[54beb17c-82b8-45c1-b60d-31a655597008]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:26 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718" returned: 0 in 0.399s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:26 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 Aug 24 10:14:26 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:27 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 Aug 24 10:14:27 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:27 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819" returned: 0 in 0.340s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:27 devstack sudo[114523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819 Aug 24 10:14:27 devstack sudo[114523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:27 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:27 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1 Aug 24 10:14:27 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:27 devstack sudo[114523]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718.d159c4b8-ed09-4753-9121-aa1859af1819" returned: 0 in 0.236s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-d159c4b8-ed09-4753-9121-aa1859af1819" released by "_delete_snapshot" :: held 1.498s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-0efe29b3-572f-4842-a149-2b7c826eb718" released by "delete_snapshot" :: held 1.524s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:27 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9a50c038-b860-4fc9-b2ba-8f851700b9d1" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Created reservations ['6e40e615-f98d-44d9-984d-bc3a67632713', '4fdead91-069d-4da2-80f1-028c715f939a', '5fbd9770-ee68-4083-b429-8655ad9abddb', '62729bfc-735f-4f64-b329-5f5a4079eaf7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9a50c038-b860-4fc9-b2ba-8f851700b9d1" released by "delete_volume" :: held 0.748s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Delete snapshot completed successfully. Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-67856d71-ae63-40b9-8ed5-37bbf8d7e988 tempest-ProjectReaderTests-150164153 None] Lock "cinder-d159c4b8-ed09-4753-9121-aa1859af1819-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Created reservations ['a1add7af-8037-4448-b71e-95b3930cae2e', '620235e3-f8eb-4be5-9234-f34067c15450', '70ac16c4-b8c4-48e1-91f6-71c4c49aa1e7', '0772b905-1cd8-4342-9849-4b7bb2a58390'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:27 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:27 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:28 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.250s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:28 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-4d7111fb-0ba3-41bd-8323-260590bb6ada tempest-ProjectMemberTests-1824643926 None] Lock "cinder-9a50c038-b860-4fc9-b2ba-8f851700b9d1-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-0efe29b3-572f-4842-a149-2b7c826eb718-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Lock "cinder-0efe29b3-572f-4842-a149-2b7c826eb718-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Acquiring lock "cinder-quobyte-0efe29b3-572f-4842-a149-2b7c826eb718" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-0efe29b3-572f-4842-a149-2b7c826eb718" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[032efbf3-10f7-498e-a284-2b71c2589c0b]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:28 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 Aug 24 10:14:28 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (5e3282c5-803e-4dff-af5f-9d3e7a46a4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7095298-fb01-4a18-a5a3-8705ae9faa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7095298-fb01-4a18-a5a3-8705ae9faa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282672005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6087363b-2941-41bb-a25f-573c05296e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:28Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0bf3ca-18ec-4c97-85c6-20a1133ccd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0bf3ca-18ec-4c97-85c6-20a1133ccd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d8c51d-0e28-47dc-a5df-c1c61d795cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d8c51d-0e28-47dc-a5df-c1c61d795cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6087363b-2941-41bb-a25f-573c05296e20', 'volume_name': 'volume-6087363b-2941-41bb-a25f-573c05296e20', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddebf0c0-a96f-4901-860e-2f1ac398b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddebf0c0-a96f-4901-860e-2f1ac398b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938ed858-dc38-4f1d-bb79-c8e05d295ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:28 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Volume 6087363b-2941-41bb-a25f-573c05296e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6087363b-2941-41bb-a25f-573c05296e20', 'volume_size': 1} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282672005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6087363b-2941-41bb-a25f-573c05296e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:28Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Creating volume 6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:28 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:28 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 1073741824 Aug 24 10:14:28 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:28 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718" returned: 0 in 0.359s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:28 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718 Aug 24 10:14:28 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:28 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-0efe29b3-572f-4842-a149-2b7c826eb718" returned: 0 in 0.258s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Lock "cinder-quobyte-0efe29b3-572f-4842-a149-2b7c826eb718" released by "delete_volume" :: held 0.684s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:28 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 1073741824" returned: 0 in 0.443s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Created reservations ['64a8b448-0ea7-400f-b932-8e1d92ffa9f6', '9a5b9898-4a67-447d-b6e8-35863385cd0b', '71d17c26-e536-4fb4-8dd9-3788a4519b47', '7a2d6ea0-f3d6-47b0-94dc-016e360aea12'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:29 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 Aug 24 10:14:29 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:29 devstack sudo[114547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:29 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:29 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938ed858-dc38-4f1d-bb79-c8e05d295ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6087363b-2941-41bb-a25f-573c05296e20', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f62643-be20-4757-9b91-e8f04ab2aa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:29 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Volume volume-6087363b-2941-41bb-a25f-573c05296e20 (6087363b-2941-41bb-a25f-573c05296e20): created successfully Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f62643-be20-4757-9b91-e8f04ab2aa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (5e3282c5-803e-4dff-af5f-9d3e7a46a4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:29 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.278s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-78529ed7-e643-4f7a-a927-2686774346d1 tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:14:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Deleted volume successfully. Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-f2fad8a3-fef2-4a9b-907b-5ac7f50301a9 tempest-ProjectReaderTests-150164153 None] Lock "cinder-0efe29b3-572f-4842-a149-2b7c826eb718-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot bee5af8d-9403-4f4b-b619-a5d0e5d16591 of volume 6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98ac77-9da4-4a4e-b185-dbd053c85e90]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:29 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 Aug 24 10:14:29 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:30 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20" returned: 0 in 0.425s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:30 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 1G Aug 24 10:14:30 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:30 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 1G" returned: 0 in 0.440s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6087363b-2941-41bb-a25f-573c05296e20 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:30 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6087363b-2941-41bb-a25f-573c05296e20 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 Aug 24 10:14:30 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:30 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6087363b-2941-41bb-a25f-573c05296e20 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591" returned: 0 in 0.341s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:30 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 is being set with open permissions: ugo+rw Aug 24 10:14:30 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:30 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 Aug 24 10:14:30 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:31 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591" returned: 0 in 0.288s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:31 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info Aug 24 10:14:31 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:31 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:31 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info is being set with open permissions: ugo+rw Aug 24 10:14:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:31 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info Aug 24 10:14:31 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:31 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.info" returned: 0 in 0.265s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:31 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:31 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a4222eaa-fbdf-4885-a066-c802f1ad1c8a tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-bee5af8d-9403-4f4b-b619-a5d0e5d16591-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-bee5af8d-9403-4f4b-b619-a5d0e5d16591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-6087363b-2941-41bb-a25f-573c05296e20" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-6087363b-2941-41bb-a25f-573c05296e20" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-bee5af8d-9403-4f4b-b619-a5d0e5d16591" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-bee5af8d-9403-4f4b-b619-a5d0e5d16591" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot bee5af8d-9403-4f4b-b619-a5d0e5d16591 of volume 6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[00538ac3-669b-41b1-abd9-3882e831bade]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:32 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:33 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 Aug 24 10:14:33 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:33 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591" returned: 0 in 0.419s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:33 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6087363b-2941-41bb-a25f-573c05296e20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:33 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dbe9b8-8321-4f6f-9f46-0556125240b6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:33 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 Aug 24 10:14:33 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:33 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20" returned: 0 in 0.382s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:33 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:33 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 Aug 24 10:14:33 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:34 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591" returned: 0 in 0.368s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:34 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591 Aug 24 10:14:34 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:34 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20.bee5af8d-9403-4f4b-b619-a5d0e5d16591" returned: 0 in 0.280s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-bee5af8d-9403-4f4b-b619-a5d0e5d16591" released by "_delete_snapshot" :: held 1.568s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-6087363b-2941-41bb-a25f-573c05296e20" released by "delete_snapshot" :: held 1.594s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Created reservations ['999a84c6-a6b3-4d2c-98e3-09c31ad12d81', 'c98897d3-e1a6-425d-8eaf-2686b30cff68', '2aa5884b-f97f-47fb-96a1-bcffce482f9f', '7f0bedaa-c659-4e3a-9bed-7b7886b8ae16'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:34 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-44f45c84-58ca-4e9e-83d9-971b22212578 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-bee5af8d-9403-4f4b-b619-a5d0e5d16591-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:34 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-6087363b-2941-41bb-a25f-573c05296e20-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-6087363b-2941-41bb-a25f-573c05296e20-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-6087363b-2941-41bb-a25f-573c05296e20" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-6087363b-2941-41bb-a25f-573c05296e20" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb21f1b0-ff0a-4209-8848-2097c97efb1f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:35 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 Aug 24 10:14:35 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:35 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20" returned: 0 in 0.409s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:35 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20 Aug 24 10:14:35 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:35 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-6087363b-2941-41bb-a25f-573c05296e20" returned: 0 in 0.254s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-6087363b-2941-41bb-a25f-573c05296e20" released by "delete_volume" :: held 0.737s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Created reservations ['3f3be0a4-db4c-4e26-a63c-9179b5f22a90', '183c7d00-f22f-4989-b8ac-e71bfbede7df', '903a8a25-039a-45fa-9018-75cfd0487718', '06f7b682-65fb-4491-b4f4-cd3dc0f9d29b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:35 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:35 devstack sudo[114603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:35 devstack sudo[114603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:36 devstack sudo[114603]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.255s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:36 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-7984e991-a686-4486-a1ae-c5eee4d1036e tempest-ProjectMemberTests-1824643926 None] Lock "cinder-6087363b-2941-41bb-a25f-573c05296e20-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (e02bff4c-09f5-44c4-8992-f7ef9876e508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a61bb6-e5d3-4bbf-88de-d84e4c995c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a61bb6-e5d3-4bbf-88de-d84e4c995c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022773084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40229ba4-96d0-4494-ae60-91d05f8ccbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:37Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e79111-4ba8-49f8-ba5e-0f39f272de07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e79111-4ba8-49f8-ba5e-0f39f272de07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4730c-3713-4855-a313-116043f85cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea4730c-3713-4855-a313-116043f85cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40229ba4-96d0-4494-ae60-91d05f8ccbe6', 'volume_name': 'volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293c2cc9-3f99-4f3c-94c0-0f55653b414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293c2cc9-3f99-4f3c-94c0-0f55653b414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb4ba24-b635-4881-b890-614e62ab120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:36 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Volume 40229ba4-96d0-4494-ae60-91d05f8ccbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6', 'volume_size': 1} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022773084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40229ba4-96d0-4494-ae60-91d05f8ccbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:37Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Creating volume 40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:36 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:36 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:36 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 1073741824 Aug 24 10:14:36 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:37 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 1073741824" returned: 0 in 0.454s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:37 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 Aug 24 10:14:37 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:37 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6" returned: 0 in 0.258s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb4ba24-b635-4881-b890-614e62ab120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786df24a-f576-4068-9e83-62c885e31df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:37 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Volume volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 (40229ba4-96d0-4494-ae60-91d05f8ccbe6): created successfully Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786df24a-f576-4068-9e83-62c885e31df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (e02bff4c-09f5-44c4-8992-f7ef9876e508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:37 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-909d16fc-170d-4280-b9e4-0d5b2ca41513 tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:37 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot be9b5480-1daa-48d8-ac75-d643e807c6e7 of volume 40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:38 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fb68be-3ec6-4179-a158-addd97ecc405]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:38 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 Aug 24 10:14:38 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:38 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6" returned: 0 in 0.399s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:38 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 1G Aug 24 10:14:38 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:38 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 1G" returned: 0 in 0.438s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:38 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:38 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 Aug 24 10:14:38 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:39 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7" returned: 0 in 0.339s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:39 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 is being set with open permissions: ugo+rw Aug 24 10:14:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:39 devstack sudo[114668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 Aug 24 10:14:39 devstack sudo[114668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:39 devstack sudo[114668]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:39 devstack sudo[114671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info Aug 24 10:14:39 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:39 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info" returned: 0 in 0.260s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:39 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info is being set with open permissions: ugo+rw Aug 24 10:14:39 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:39 devstack sudo[114674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info Aug 24 10:14:39 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:40 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.info" returned: 0 in 0.302s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:40 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:40 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-115c610e-96ae-400b-808c-80d9f0e9fba6 tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-be9b5480-1daa-48d8-ac75-d643e807c6e7-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-be9b5480-1daa-48d8-ac75-d643e807c6e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-40229ba4-96d0-4494-ae60-91d05f8ccbe6" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-40229ba4-96d0-4494-ae60-91d05f8ccbe6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-be9b5480-1daa-48d8-ac75-d643e807c6e7" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-be9b5480-1daa-48d8-ac75-d643e807c6e7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot be9b5480-1daa-48d8-ac75-d643e807c6e7 of volume 40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[e087947c-2748-4616-ae4c-a3361ac69447]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:41 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 Aug 24 10:14:41 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:41 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7" returned: 0 in 0.403s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5cb56-bd58-434b-94fc-f48d7080f5ca]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:41 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:41 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 Aug 24 10:14:41 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:42 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6" returned: 0 in 0.410s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:42 devstack sudo[114694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 Aug 24 10:14:42 devstack sudo[114694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:42 devstack sudo[114694]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7" returned: 0 in 0.390s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:42 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7 Aug 24 10:14:42 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:42 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6.be9b5480-1daa-48d8-ac75-d643e807c6e7" returned: 0 in 0.320s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-be9b5480-1daa-48d8-ac75-d643e807c6e7" released by "_delete_snapshot" :: held 1.634s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-40229ba4-96d0-4494-ae60-91d05f8ccbe6" released by "delete_snapshot" :: held 1.659s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:42 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Created reservations ['b5d1e9d3-9911-4e49-8b19-fe432a84a624', 'd978e28d-6db6-47ec-bdd7-44d7590498a3', '02b119d8-ee4f-4d6b-ae34-9a291951be73', 'ba0bc41e-7b6b-4b48-a2d2-870c89361da1'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:43 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-585490dc-38ea-4a3b-ad21-509084b09ca3 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-be9b5480-1daa-48d8-ac75-d643e807c6e7-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-40229ba4-96d0-4494-ae60-91d05f8ccbe6-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-40229ba4-96d0-4494-ae60-91d05f8ccbe6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-40229ba4-96d0-4494-ae60-91d05f8ccbe6" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-40229ba4-96d0-4494-ae60-91d05f8ccbe6" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[266a4211-7c13-4843-97cd-16ceee6b8144]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:43 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 Aug 24 10:14:43 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:43 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6" returned: 0 in 0.389s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:43 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:43 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6 Aug 24 10:14:43 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:44 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-40229ba4-96d0-4494-ae60-91d05f8ccbe6" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-40229ba4-96d0-4494-ae60-91d05f8ccbe6" released by "delete_volume" :: held 0.727s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Created reservations ['30450794-c3b0-4666-946d-4b7a1f69a1ee', '97c34285-611c-4f71-88f5-0f34377e9a41', '7e147bcb-b7ca-47a5-9c2e-b5eefe03ae11', 'd7f00454-7ed2-4988-9b34-62903e5b3bb6'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:44 devstack sudo[114710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:44 devstack sudo[114710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:44 devstack sudo[114710]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.280s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:44 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:14:44 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-00f9b80c-d935-4b6f-8acb-64f3f8900792 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-40229ba4-96d0-4494-ae60-91d05f8ccbe6-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (8ee595c3-0f77-41f8-b93e-534c56ba085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ca4a45-dd1e-4f67-927d-3011b2d15eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ca4a45-dd1e-4f67-927d-3011b2d15eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105387285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fd7ae5-ef87-4e98-a777-be14e06f5fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:45Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5bd200-a6ee-44d0-a20b-e09fba0866a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5bd200-a6ee-44d0-a20b-e09fba0866a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ab4f0a-a509-4d37-8ea1-37cd5bb33a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ab4f0a-a509-4d37-8ea1-37cd5bb33a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fd7ae5-ef87-4e98-a777-be14e06f5fe0', 'volume_name': 'volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5e59df-39fb-4c52-9c06-14ade27194e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5e59df-39fb-4c52-9c06-14ade27194e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60141f2b-9efa-405f-ad0a-e1fd5c6bf33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:45 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Volume 94fd7ae5-ef87-4e98-a777-be14e06f5fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0', 'volume_size': 1} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105387285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94fd7ae5-ef87-4e98-a777-be14e06f5fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:45Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Creating volume 94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:45 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:45 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 1073741824 Aug 24 10:14:45 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:45 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 1073741824" returned: 0 in 0.429s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:45 devstack sudo[114720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 Aug 24 10:14:45 devstack sudo[114720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:45 devstack sudo[114720]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" returned: 0 in 0.281s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:45 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60141f2b-9efa-405f-ad0a-e1fd5c6bf33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9937053c-250d-4366-9e6a-27bb1ae71a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:46 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Volume volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 (94fd7ae5-ef87-4e98-a777-be14e06f5fe0): created successfully Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9937053c-250d-4366-9e6a-27bb1ae71a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (8ee595c3-0f77-41f8-b93e-534c56ba085e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:46 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-40ee0b66-336b-40d4-9b05-595d65b4be0c tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot 97b882c1-f68c-4b92-b42f-734da5638ae6 of volume 94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[864274fb-45b6-47f7-b363-488e8b90a789]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:46 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 Aug 24 10:14:46 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:46 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" returned: 0 in 0.383s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:46 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:46 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 1G Aug 24 10:14:46 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:47 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 1G" returned: 0 in 0.492s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:47 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 Aug 24 10:14:47 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:47 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:47 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 is being set with open permissions: ugo+rw Aug 24 10:14:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:47 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 Aug 24 10:14:47 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:47 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6" returned: 0 in 0.248s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:47 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:47 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info Aug 24 10:14:47 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:48 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info" returned: 0 in 0.249s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:48 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info is being set with open permissions: ugo+rw Aug 24 10:14:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:48 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info Aug 24 10:14:48 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:48 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.info" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:48 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.141s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:48 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-49ead8f8-271b-4c6b-bcc7-f5a82a0402dd tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-97b882c1-f68c-4b92-b42f-734da5638ae6-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-97b882c1-f68c-4b92-b42f-734da5638ae6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-97b882c1-f68c-4b92-b42f-734da5638ae6" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-97b882c1-f68c-4b92-b42f-734da5638ae6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot 97b882c1-f68c-4b92-b42f-734da5638ae6 of volume 94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc7411c-8554-4746-a93a-ca6b006bf317]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:49 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:49 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 Aug 24 10:14:49 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:50 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6" returned: 0 in 0.398s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5088a-c537-435f-8049-022e63cf0c6e]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:50 devstack sudo[114754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 Aug 24 10:14:50 devstack sudo[114754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:50 devstack sudo[114754]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" returned: 0 in 0.422s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:50 devstack sudo[114759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 Aug 24 10:14:50 devstack sudo[114759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:50 devstack sudo[114759]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6" returned: 0 in 0.398s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:50 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:50 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6 Aug 24 10:14:50 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:51 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0.97b882c1-f68c-4b92-b42f-734da5638ae6" returned: 0 in 0.271s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-97b882c1-f68c-4b92-b42f-734da5638ae6" released by "_delete_snapshot" :: held 1.592s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" released by "delete_snapshot" :: held 1.618s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Created reservations ['d9d885b1-e7c6-4d03-a6ab-c7e241aa93cb', '3f741e35-296c-4176-91ba-819ce22a6773', '5b3f07c4-5cd3-47f5-a157-8b6840115ba4', '5e5e15ad-c205-4833-885e-72b904818ba5'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:51 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cbe1031-9450-4bb9-86e2-e13fb0b1dfb7 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-97b882c1-f68c-4b92-b42f-734da5638ae6-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-94fd7ae5-ef87-4e98-a777-be14e06f5fe0-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-94fd7ae5-ef87-4e98-a777-be14e06f5fe0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f050b649-8466-465b-8f23-583d8192d50a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:51 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:52 devstack sudo[114769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 Aug 24 10:14:52 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:52 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" returned: 0 in 0.421s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:52 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0 Aug 24 10:14:52 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:52 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-94fd7ae5-ef87-4e98-a777-be14e06f5fe0" released by "delete_volume" :: held 0.784s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Created reservations ['ceec777f-f7d3-4a99-b60d-90f425b92b3b', '4527c80e-acab-4fb1-b953-730eef922275', '68a62516-eba8-4e77-afd2-2b836e271a09', '7d65492f-20cb-4c53-9790-daf9ce315b98'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:52 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:52 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:14:52 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:53 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.309s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:14:53 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-2f6714bf-1cea-41a3-bdac-0d17822705d0 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-94fd7ae5-ef87-4e98-a777-be14e06f5fe0-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (21439ec3-c7f2-4fea-8437-ec5a6cd73d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ff46e-a07c-4da0-b916-c245681e860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ff46e-a07c-4da0-b916-c245681e860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700593213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c0b918-4d68-4372-bcda-7b424482a939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:54Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544c21c1-2607-49d1-8c2a-0f8da8347d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544c21c1-2607-49d1-8c2a-0f8da8347d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be729b9-6ce1-4f54-8a78-cbb217365d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be729b9-6ce1-4f54-8a78-cbb217365d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c0b918-4d68-4372-bcda-7b424482a939', 'volume_name': 'volume-34c0b918-4d68-4372-bcda-7b424482a939', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450481c2-031b-4b9e-80a0-63ac64bcd1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450481c2-031b-4b9e-80a0-63ac64bcd1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1623946-f2ab-40eb-b240-4a59bcd26f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:53 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Volume 34c0b918-4d68-4372-bcda-7b424482a939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c0b918-4d68-4372-bcda-7b424482a939', 'volume_size': 1} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1700593213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c0b918-4d68-4372-bcda-7b424482a939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:54Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Creating volume 34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:53 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:53 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:53 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 1073741824 Aug 24 10:14:53 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:54 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 1073741824" returned: 0 in 0.452s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:54 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 Aug 24 10:14:54 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Flow 'volume_create_manager' (674771ae-a3b0-4f84-bd07-1aa37ff77fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641c851a-5ad9-4ef1-a09c-08799f8e9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641c851a-5ad9-4ef1-a09c-08799f8e9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1143401987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e8a563-c6e5-440c-9059-9e02d0a72989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad63998564e4b0e8738c6026ee9f650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:54Z,use_quota=True,user_id='7fb92889b15b49638f6a8e0fcdb76450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c27fba-1f5c-4b93-bdad-26623ceb5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c27fba-1f5c-4b93-bdad-26623ceb5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956725ae-b21a-4fec-b5ee-e60a2f8af9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956725ae-b21a-4fec-b5ee-e60a2f8af9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e8a563-c6e5-440c-9059-9e02d0a72989', 'volume_name': 'volume-a8e8a563-c6e5-440c-9059-9e02d0a72989', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15817ceb-7b37-4f7d-8779-e3148534158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15817ceb-7b37-4f7d-8779-e3148534158e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ba6086-04aa-4ea0-b3e8-98f4820c02ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Volume a8e8a563-c6e5-440c-9059-9e02d0a72989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e8a563-c6e5-440c-9059-9e02d0a72989', 'volume_size': 1} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:54 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1143401987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e8a563-c6e5-440c-9059-9e02d0a72989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad63998564e4b0e8738c6026ee9f650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:54Z,use_quota=True,user_id='7fb92889b15b49638f6a8e0fcdb76450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Creating volume a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:54 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1623946-f2ab-40eb-b240-4a59bcd26f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c0b918-4d68-4372-bcda-7b424482a939', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:54 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 1073741824 Aug 24 10:14:54 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6580786b-53f7-4a13-a80b-7ba8aaadce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:54 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Volume volume-34c0b918-4d68-4372-bcda-7b424482a939 (34c0b918-4d68-4372-bcda-7b424482a939): created successfully Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6580786b-53f7-4a13-a80b-7ba8aaadce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (21439ec3-c7f2-4fea-8437-ec5a6cd73d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:54 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-47497e0a-a054-4913-9b3a-fa247e5d926f tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:14:54 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 1073741824" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:54 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:55 devstack sudo[114794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 Aug 24 10:14:55 devstack sudo[114794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:55 devstack sudo[114794]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989" returned: 0 in 0.288s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ba6086-04aa-4ea0-b3e8-98f4820c02ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e8a563-c6e5-440c-9059-9e02d0a72989', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c343b01-7831-4a39-83b6-13d9acdd9389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:55 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Volume volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 (a8e8a563-c6e5-440c-9059-9e02d0a72989): created successfully Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c343b01-7831-4a39-83b6-13d9acdd9389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Flow 'volume_create_manager' (674771ae-a3b0-4f84-bd07-1aa37ff77fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:55 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b92432fe-eb91-4485-98bb-5efe86ca8771 tempest-SnapshotDependencyTests-1461603070 None] Created volume successfully. Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Creating offline snapshot b18bbe9c-84ac-4b91-a297-d973a75ec3b2 of volume a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[215b5cd9-5e72-42b0-bb30-a31308b11f62]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:55 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 Aug 24 10:14:55 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:55 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:56 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989" returned: 0 in 0.353s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:56 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 1G Aug 24 10:14:56 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:56 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 1G" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:56 devstack sudo[114809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 Aug 24 10:14:56 devstack sudo[114809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:56 devstack sudo[114809]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2" returned: 0 in 0.300s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:56 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 is being set with open permissions: ugo+rw Aug 24 10:14:56 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:56 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 Aug 24 10:14:56 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:57 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2" returned: 0 in 0.237s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:DELETE=22,cinder:SELECT=145,cinder:UPDATE=201,cinder:INSERT=55 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:UPDATE=196,cinder:INSERT=58,cinder:SELECT=166,cinder:DELETE=12 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:57 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info Aug 24 10:14:57 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:57 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info" returned: 0 in 0.261s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:57 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info is being set with open permissions: ugo+rw Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:57 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info Aug 24 10:14:57 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:57 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.info" returned: 0 in 0.237s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.708s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot c9eb3510-88c2-4bd5-94ed-52e1842cf998 of volume 34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2754106-50bc-4f5e-9271-49e8aaa10300]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:57 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-3c519638-4d67-4888-8f1b-8cf2b22224ff tempest-SnapshotDependencyTests-1461603070 None] Create snapshot completed successfully Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:57 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 Aug 24 10:14:57 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:57 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939" returned: 0 in 0.353s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:57 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:58 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 1G Aug 24 10:14:58 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:14:58 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 1G" returned: 0 in 0.438s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c0b918-4d68-4372-bcda-7b424482a939 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:58 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c0b918-4d68-4372-bcda-7b424482a939 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 Aug 24 10:14:58 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Flow 'volume_create_manager' (cd9654cd-f30c-4856-b5e4-58cceddd829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee521d5-e99e-4d69-8e9b-aa698884c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee521d5-e99e-4d69-8e9b-aa698884c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad63998564e4b0e8738c6026ee9f650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b18bbe9c-84ac-4b91-a297-d973a75ec3b2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:14:58Z,use_quota=True,user_id='7fb92889b15b49638f6a8e0fcdb76450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38161c7-84ff-43ce-a02f-99b02c6b532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38161c7-84ff-43ce-a02f-99b02c6b532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d890629d-2866-4631-b860-1ac5c6b6e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d890629d-2866-4631-b860-1ac5c6b6e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7', 'volume_name': 'volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7', 'volume_size': 1, 'snapshot_id': 'b18bbe9c-84ac-4b91-a297-d973a75ec3b2'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8b0187-09a8-4752-8bfe-5e8119edf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d8b0187-09a8-4752-8bfe-5e8119edf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39d405d-e66e-439a-ba6f-8accc827d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:14:58 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Volume fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7', 'volume_size': 1, 'snapshot_id': 'b18bbe9c-84ac-4b91-a297-d973a75ec3b2'} Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:58 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c0b918-4d68-4372-bcda-7b424482a939 -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998" returned: 0 in 0.285s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:58 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 is being set with open permissions: ugo+rw Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:58 devstack sudo[114840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 Aug 24 10:14:58 devstack sudo[114840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:58 devstack sudo[114840]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:58 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998" returned: 0 in 0.253s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:59 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info Aug 24 10:14:59 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:59 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info" returned: 0 in 0.252s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:59 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info is being set with open permissions: ugo+rw Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:59 devstack sudo[114848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info Aug 24 10:14:59 devstack sudo[114848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:59 devstack sudo[114848]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.info" returned: 0 in 0.244s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.974s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-quobyte-b18bbe9c-84ac-4b91-a297-d973a75ec3b2-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" by "_create_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-b18bbe9c-84ac-4b91-a297-d973a75ec3b2-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Creating volume fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 from snapshot b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-quobyte-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" by "_copy_volume_from_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:14:59 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-87b31b99-9418-4b7a-980d-f6e6dd5958b0 tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] snapshot: b18bbe9c-84ac-4b91-a297-d973a75ec3b2, volume: fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7, {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f9757-d2ed-4776-994e-2489dd2cc2b2]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:14:59 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 Aug 24 10:14:59 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:14:59 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2" returned: 0 in 0.363s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e8a563-c6e5-440c-9059-9e02d0a72989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02cf4d3-ff49-41ab-b456-7985264893df]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:14:59 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-c9eb3510-88c2-4bd5-94ed-52e1842cf998-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-c9eb3510-88c2-4bd5-94ed-52e1842cf998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-34c0b918-4d68-4372-bcda-7b424482a939" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:00 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 Aug 24 10:15:00 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-34c0b918-4d68-4372-bcda-7b424482a939" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-c9eb3510-88c2-4bd5-94ed-52e1842cf998" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-c9eb3510-88c2-4bd5-94ed-52e1842cf998" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot c9eb3510-88c2-4bd5-94ed-52e1842cf998 of volume 34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a7f04-6f7a-4464-8ba5-252b71713319]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:00 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 Aug 24 10:15:00 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:00 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Creating direct copy from snapshot {{(pid=94039) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.utils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Path /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 not found in is_blk_device check {{(pid=94039) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:00 devstack sudo[114863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 Aug 24 10:15:00 devstack sudo[114863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:00 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998" returned: 0 in 0.395s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c0b918-4d68-4372-bcda-7b424482a939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea7a05-0a06-4a05-987f-020f9ad91c9a]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:00 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:00 devstack sudo[114868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 Aug 24 10:15:00 devstack sudo[114868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:01 devstack sudo[114868]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939" returned: 0 in 0.556s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:01 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:01 devstack sudo[114885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 Aug 24 10:15:01 devstack sudo[114885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:02 devstack sudo[114885]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998" returned: 0 in 0.847s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:02 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998 Aug 24 10:15:02 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:02 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939.c9eb3510-88c2-4bd5-94ed-52e1842cf998" returned: 0 in 0.438s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-c9eb3510-88c2-4bd5-94ed-52e1842cf998" released by "_delete_snapshot" :: held 2.375s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-34c0b918-4d68-4372-bcda-7b424482a939" released by "delete_snapshot" :: held 2.412s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Created reservations ['40775295-b3f8-4a14-b174-dc2b15aee833', '47179190-26ad-4c02-b37c-770198b71df1', '9b78efb5-5298-4c62-b31a-1b400af47dfa', 'b9f8b5c6-76e3-42a3-ac4a-d72cd8e57c7b'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:02 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:15:02 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-94172320-acf5-4245-a88c-2d2f0604ce38 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-c9eb3510-88c2-4bd5-94ed-52e1842cf998-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-34c0b918-4d68-4372-bcda-7b424482a939-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Lock "cinder-34c0b918-4d68-4372-bcda-7b424482a939-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-34c0b918-4d68-4372-bcda-7b424482a939" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:03 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-34c0b918-4d68-4372-bcda-7b424482a939" acquired by "delete_volume" :: waited 0.029s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:03 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b880a458-efc2-4916-8ea9-c43434e8d058]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:03 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:04 devstack sudo[114897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 Aug 24 10:15:04 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:04 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939" returned: 0 in 0.842s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:04 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:04 devstack sudo[114902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939 Aug 24 10:15:04 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:05 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-34c0b918-4d68-4372-bcda-7b424482a939" returned: 0 in 0.477s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-34c0b918-4d68-4372-bcda-7b424482a939" released by "delete_volume" :: held 1.435s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:05 devstack sudo[114863]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" returned: 0 in 4.738s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.image.image_utils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Image conversion details: src /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 {{(pid=94039) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 24 10:15:05 devstack cinder-volume[94039]: INFO cinder.image.image_utils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Converted 1024.00 MB image at 216.08 MB/s Aug 24 10:15:05 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 is being set with open permissions: ugo+rw Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:05 devstack sudo[114905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 Aug 24 10:15:05 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Created reservations ['378c1eaa-b5ee-47b8-9921-d52cc6b3c967', 'a9fd1067-0c43-4c24-ba67-51e47274507b', 'd7caa647-bbb5-4ed2-9b58-2ce4f962dbb4', '36da1d96-bfa0-4073-94dd-131c4adf04b8'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:05 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:05 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:05 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" returned: 0 in 0.243s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" released by "_copy_volume_from_snapshot" :: held 5.838s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-b18bbe9c-84ac-4b91-a297-d973a75ec3b2-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" released by "_create_volume_from_snapshot" :: held 5.900s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.924s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39d405d-e66e-439a-ba6f-8accc827d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7', 'volume_size': 1, 'snapshot_id': 'b18bbe9c-84ac-4b91-a297-d973a75ec3b2'}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b449433c-2457-4d1a-9abf-5eed4bc3bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:05 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Volume volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 (fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7): created successfully Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b449433c-2457-4d1a-9abf-5eed4bc3bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Flow 'volume_create_manager' (cd9654cd-f30c-4856-b5e4-58cceddd829f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1192502e-0443-45bd-826c-ad9f996e1c70 tempest-SnapshotDependencyTests-1461603070 None] Created volume successfully. Aug 24 10:15:05 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:05 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:15:05 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-a53c0c58-4a92-4cc7-98ae-f2e9a073077a tempest-ProjectMemberTests-1824643926 None] Lock "cinder-34c0b918-4d68-4372-bcda-7b424482a939-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-b18bbe9c-84ac-4b91-a297-d973a75ec3b2-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-b18bbe9c-84ac-4b91-a297-d973a75ec3b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-quobyte-a8e8a563-c6e5-440c-9059-9e02d0a72989" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-a8e8a563-c6e5-440c-9059-9e02d0a72989" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-quobyte-b18bbe9c-84ac-4b91-a297-d973a75ec3b2" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-b18bbe9c-84ac-4b91-a297-d973a75ec3b2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Deleting offline snapshot b18bbe9c-84ac-4b91-a297-d973a75ec3b2 of volume a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] snapshot_file for this snap is: volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4496a274-64e3-43d4-a5ab-411c573e1dc3]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (65bc5603-780f-4ca6-a2d8-563e7bd38a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdfe1f4-51c5-4d26-819f-5971cd674221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:06 devstack sudo[114911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 Aug 24 10:15:06 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdfe1f4-51c5-4d26-819f-5971cd674221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620858613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb2f821-088a-4f3e-b918-6916d5a4accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:15:06Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2940ac2-4ede-43d7-a17a-bb7330f2a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2940ac2-4ede-43d7-a17a-bb7330f2a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46472be8-60be-46ae-998c-9eaab4b6a05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46472be8-60be-46ae-998c-9eaab4b6a05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb2f821-088a-4f3e-b918-6916d5a4accf', 'volume_name': 'volume-9eb2f821-088a-4f3e-b918-6916d5a4accf', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c15f52d-c36b-466b-911f-dab835292151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c15f52d-c36b-466b-911f-dab835292151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cee6dcf-3e31-405d-a3ac-23d9a5608cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:06 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Volume 9eb2f821-088a-4f3e-b918-6916d5a4accf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb2f821-088a-4f3e-b918-6916d5a4accf', 'volume_size': 1} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620858613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb2f821-088a-4f3e-b918-6916d5a4accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:15:06Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Creating volume 9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:15:06 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:06 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf 1073741824 Aug 24 10:15:06 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:06 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2" returned: 0 in 0.360s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e8a563-c6e5-440c-9059-9e02d0a72989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[27264ca9-d2fd-44ee-a386-2b8dbeb50ea1]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:06 devstack sudo[114920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 Aug 24 10:15:06 devstack sudo[114920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:06 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf 1073741824" returned: 0 in 0.416s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:06 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:06 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf Aug 24 10:15:06 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:07 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf" returned: 0 in 0.244s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cee6dcf-3e31-405d-a3ac-23d9a5608cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb2f821-088a-4f3e-b918-6916d5a4accf', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2602712f-8555-4634-845d-68a4799d616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:07 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Volume volume-9eb2f821-088a-4f3e-b918-6916d5a4accf (9eb2f821-088a-4f3e-b918-6916d5a4accf): created successfully Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2602712f-8555-4634-845d-68a4799d616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (65bc5603-780f-4ca6-a2d8-563e7bd38a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:07 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-b52d5ec2-740e-4633-a811-3ee703c4ac36 tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:15:07 devstack sudo[114920]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989" returned: 0 in 0.573s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:07 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 Aug 24 10:15:07 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot cc7a09e6-7f1f-4096-9d40-580cf48c97fd of volume 9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2be742-c51c-4a08-b10e-dc595e2e6749]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:07 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2" returned: 0 in 0.377s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:07 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2 Aug 24 10:15:07 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:07 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf Aug 24 10:15:07 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:07 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989.b18bbe9c-84ac-4b91-a297-d973a75ec3b2" returned: 0 in 0.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-b18bbe9c-84ac-4b91-a297-d973a75ec3b2" released by "_delete_snapshot" :: held 1.665s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:07 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-a8e8a563-c6e5-440c-9059-9e02d0a72989" released by "delete_snapshot" :: held 1.691s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf" returned: 0 in 0.379s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:07 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:08 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd 1G Aug 24 10:15:08 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Created reservations ['10680f89-ea47-4053-9bdf-b332890c3f61', '934d48a0-68d8-40f6-9b6d-a316906e60c3', '48131834-f8b3-42d0-a329-49e905aa15a7', '0a225fe6-9524-475a-952d-a46fd199741d'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:08 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Delete snapshot completed successfully. Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-37fb5515-fbc6-4c6f-99eb-bb7b33652b06 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-b18bbe9c-84ac-4b91-a297-d973a75ec3b2-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:08 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd 1G" returned: 0 in 0.423s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb2f821-088a-4f3e-b918-6916d5a4accf -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-a8e8a563-c6e5-440c-9059-9e02d0a72989-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:08 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb2f821-088a-4f3e-b918-6916d5a4accf -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd Aug 24 10:15:08 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-a8e8a563-c6e5-440c-9059-9e02d0a72989-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-quobyte-a8e8a563-c6e5-440c-9059-9e02d0a72989" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-a8e8a563-c6e5-440c-9059-9e02d0a72989" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[80025129-c3b4-40b4-b931-2d7a0a2e7780]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:08 devstack sudo[114951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 Aug 24 10:15:08 devstack sudo[114951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:08 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb2f821-088a-4f3e-b918-6916d5a4accf -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd" returned: 0 in 0.306s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:08 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd is being set with open permissions: ugo+rw Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:08 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd Aug 24 10:15:08 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:08 devstack sudo[114951]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989" returned: 0 in 0.368s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:08 devstack sudo[114962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989 Aug 24 10:15:08 devstack sudo[114962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:08 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd" returned: 0 in 0.249s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:08 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:09 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info Aug 24 10:15:09 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:09 devstack sudo[114962]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-a8e8a563-c6e5-440c-9059-9e02d0a72989" returned: 0 in 0.253s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-a8e8a563-c6e5-440c-9059-9e02d0a72989" released by "delete_volume" :: held 0.681s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Created reservations ['44f121d5-24fa-4ce7-8605-24ba3de9f5fc', 'a6cda7bc-0f7d-46bb-8f9b-454bc6c940ca', '847a10a7-a1fe-4e29-8130-2e33825cd5e8', 'a23164cd-f249-4eb1-a6c3-76d6f8d43c64'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:09 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info" returned: 0 in 0.272s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:09 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info is being set with open permissions: ugo+rw Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:09 devstack sudo[114968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info Aug 24 10:15:09 devstack sudo[114968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:09 devstack sudo[114970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:09 devstack sudo[114970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:09 devstack sudo[114968]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.info" returned: 0 in 0.241s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-4c7e9cc9-7b78-4b6c-8ea4-cc7ac7b0e474 tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:15:09 devstack sudo[114970]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.276s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:09 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Deleted volume successfully. Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-0db062bf-43f6-43bf-b193-a2745efcfb35 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-a8e8a563-c6e5-440c-9059-9e02d0a72989-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "cinder-quobyte-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" acquired by "delete_volume" :: waited 0.017s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-cc7a09e6-7f1f-4096-9d40-580cf48c97fd-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[39751093-be7b-443b-87f0-09a4f01fcd41]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Lock "cinder-cc7a09e6-7f1f-4096-9d40-580cf48c97fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-9eb2f821-088a-4f3e-b918-6916d5a4accf" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9eb2f821-088a-4f3e-b918-6916d5a4accf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-cc7a09e6-7f1f-4096-9d40-580cf48c97fd" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-cc7a09e6-7f1f-4096-9d40-580cf48c97fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot cc7a09e6-7f1f-4096-9d40-580cf48c97fd of volume 9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4ea70-6962-421c-8e13-a6223485e823]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:09 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:09 devstack sudo[114974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 Aug 24 10:15:09 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:09 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd Aug 24 10:15:09 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:10 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" returned: 0 in 0.395s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:10 devstack sudo[114982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7 Aug 24 10:15:10 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:10 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd" returned: 0 in 0.369s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb2f821-088a-4f3e-b918-6916d5a4accf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a32550-7c34-4b84-b2dc-2ad13f879195]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:10 devstack sudo[114986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf Aug 24 10:15:10 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:10 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" returned: 0 in 0.275s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-quobyte-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7" released by "delete_volume" :: held 0.719s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Created reservations ['e54e6f57-59fe-4b93-af9f-0e4ebb0b7920', '26a7b2e2-9545-4948-8f90-3fff0178120e', '11fbdb97-3883-4eb0-a314-7a23fc930d7c', '98f74033-03aa-4682-a1b6-fb2895c1c0e7'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:10 devstack sudo[114990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:10 devstack sudo[114990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:10 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf" returned: 0 in 0.375s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:10 devstack sudo[114995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd Aug 24 10:15:10 devstack sudo[114995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:10 devstack sudo[114990]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.267s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:10 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Deleted volume successfully. Aug 24 10:15:10 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-3918f1a6-0d6e-4495-ba7a-f858aa8aa5f7 tempest-SnapshotDependencyTests-1461603070 None] Lock "cinder-fac97bf6-8fa3-4dae-9e85-b4b21e7ed5f7-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:11 devstack sudo[114995]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd" returned: 0 in 0.404s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:11 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd Aug 24 10:15:11 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:11 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf.cc7a09e6-7f1f-4096-9d40-580cf48c97fd" returned: 0 in 0.256s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-cc7a09e6-7f1f-4096-9d40-580cf48c97fd" released by "_delete_snapshot" :: held 1.508s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9eb2f821-088a-4f3e-b918-6916d5a4accf" released by "delete_snapshot" :: held 1.530s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Created reservations ['1d1bf034-1737-41ee-9f46-b2009482f6e6', '49e476c4-5b56-4416-bcf7-25dfed3ac68b', 'f49211b4-b824-474b-8e37-471bbe592e03', 'bb0e81a4-1950-4326-bcf1-aa517f19d61f'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:11 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5a7f055f-2eb4-463d-ac8e-d06dec1e84af tempest-ProjectMemberTests-1824643926 None] Lock "cinder-cc7a09e6-7f1f-4096-9d40-580cf48c97fd-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-9eb2f821-088a-4f3e-b918-6916d5a4accf-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-9eb2f821-088a-4f3e-b918-6916d5a4accf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-9eb2f821-088a-4f3e-b918-6916d5a4accf" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:11 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9eb2f821-088a-4f3e-b918-6916d5a4accf" acquired by "delete_volume" :: waited 0.024s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71323d6-e6de-498f-b878-ed192a263021]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:12 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf Aug 24 10:15:12 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:12 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf" returned: 0 in 0.402s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:12 devstack sudo[115011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf Aug 24 10:15:12 devstack sudo[115011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:12 devstack sudo[115011]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-9eb2f821-088a-4f3e-b918-6916d5a4accf" returned: 0 in 0.250s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-9eb2f821-088a-4f3e-b918-6916d5a4accf" released by "delete_volume" :: held 0.714s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Created reservations ['5c649794-c6d1-4cfa-b596-f2a52fe2b950', '19bf1604-2616-4d4b-8d31-d3218fc40c14', '2a7276e0-5c72-4009-a82e-d52fbc899975', '6a118575-06d8-4052-81a2-12dd4abd7bad'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:12 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:12 devstack sudo[115014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:12 devstack sudo[115014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:13 devstack sudo[115014]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.262s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:13 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-c341892b-40bb-48f1-8a2e-e7416938dbd2 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-9eb2f821-088a-4f3e-b918-6916d5a4accf-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (70d933df-14d4-474d-aef5-69e8f60f876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ca9151-1423-4156-8308-b0e5b65243b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ca9151-1423-4156-8308-b0e5b65243b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801177419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:15:14Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eadf18-0d30-4052-814c-d43cfb3567cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85eadf18-0d30-4052-814c-d43cfb3567cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f201a21-1a0c-42f2-970c-0af95b16fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f201a21-1a0c-42f2-970c-0af95b16fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c', 'volume_name': 'volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89908a0a-7ba1-4329-9f5a-18f5620cae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89908a0a-7ba1-4329-9f5a-18f5620cae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8c4d12-8e09-4dd1-8ef5-1ac724f66f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:13 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Volume bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c', 'volume_size': 1} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801177419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:15:14Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Creating volume bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:15:13 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:15:13 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:13 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c 1073741824 Aug 24 10:15:13 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:14 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c 1073741824" returned: 0 in 0.413s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:14 devstack sudo[115023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c Aug 24 10:15:14 devstack sudo[115023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:14 devstack sudo[115023]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" returned: 0 in 0.340s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8c4d12-8e09-4dd1-8ef5-1ac724f66f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a50aabe-b0b7-4923-9069-91dff32ed033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:14 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Volume volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c (bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c): created successfully Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a50aabe-b0b7-4923-9069-91dff32ed033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:14 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (70d933df-14d4-474d-aef5-69e8f60f876e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:14 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-52bde47c-f997-4573-b8e4-463b8397d1ce tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:15:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:15 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot 3238c58d-1b47-4c00-a2b5-7630ad9757a5 of volume bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:15:15 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d080e15-f21d-4b0e-ab4b-2f0fb019ead7]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:15 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:15 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c Aug 24 10:15:15 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:16 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" returned: 0 in 0.365s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:16 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 1G Aug 24 10:15:16 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:16 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 1G" returned: 0 in 0.460s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:16 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 Aug 24 10:15:16 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:16 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5" returned: 0 in 0.304s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:16 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 is being set with open permissions: ugo+rw Aug 24 10:15:16 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:17 devstack sudo[115044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 Aug 24 10:15:17 devstack sudo[115044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:17 devstack sudo[115044]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5" returned: 0 in 0.266s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:17 devstack sudo[115047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info Aug 24 10:15:17 devstack sudo[115047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:17 devstack sudo[115047]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info" returned: 0 in 0.283s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:17 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info is being set with open permissions: ugo+rw Aug 24 10:15:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:17 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info Aug 24 10:15:17 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:17 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.info" returned: 0 in 0.248s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:17 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:17 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-fd767247-a238-4207-9bb0-7511c9ad6e71 tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:15:18 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-3238c58d-1b47-4c00-a2b5-7630ad9757a5-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Lock "cinder-3238c58d-1b47-4c00-a2b5-7630ad9757a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-3238c58d-1b47-4c00-a2b5-7630ad9757a5" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-3238c58d-1b47-4c00-a2b5-7630ad9757a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot 3238c58d-1b47-4c00-a2b5-7630ad9757a5 of volume bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9276dd8-90a5-4f86-a678-19d9e8d893ad]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:19 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 Aug 24 10:15:19 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:19 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5" returned: 0 in 0.410s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d444a64-d39f-45f3-87c5-4da897fd62b6]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:19 devstack sudo[115060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c Aug 24 10:15:19 devstack sudo[115060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:19 devstack sudo[115060]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" returned: 0 in 0.386s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:19 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:19 devstack sudo[115065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 Aug 24 10:15:19 devstack sudo[115065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:20 devstack sudo[115065]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5" returned: 0 in 0.364s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:20 devstack sudo[115070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5 Aug 24 10:15:20 devstack sudo[115070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:20 devstack sudo[115070]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c.3238c58d-1b47-4c00-a2b5-7630ad9757a5" returned: 0 in 0.288s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-3238c58d-1b47-4c00-a2b5-7630ad9757a5" released by "_delete_snapshot" :: held 1.578s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" released by "delete_snapshot" :: held 1.608s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Created reservations ['1bcece6d-a5fb-4d0b-b70a-130dd0ea969e', '57ea374d-43e8-4925-8050-363374729cf0', 'ba6aebbc-3975-4d1f-ae2b-7df7a3966dbd', '6dc5a6b4-9710-4308-bf31-3e3f42549dc1'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:20 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:15:20 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-526eafe9-bd07-4d40-b1c0-52fd709504da tempest-ProjectMemberTests-1824643926 None] Lock "cinder-3238c58d-1b47-4c00-a2b5-7630ad9757a5-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" acquired by "delete_volume" :: waited 0.022s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f25ed52-b984-4304-a325-2aae35f0377f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:21 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c Aug 24 10:15:21 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:21 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" returned: 0 in 0.349s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:21 devstack sudo[115080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c Aug 24 10:15:21 devstack sudo[115080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:21 devstack sudo[115080]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" returned: 0 in 0.244s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c" released by "delete_volume" :: held 0.658s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:21 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Created reservations ['f4b468ef-9c29-48bd-b65c-90c3a565673e', '4ceeead5-e8f6-4e5c-a1c2-16eeee4bc04e', '9af1cea3-ad01-4b68-b46d-0af4f5e08cdc', 'c5c2acb2-1669-4501-b1af-5bf5fe9b609c'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:22 devstack sudo[115083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:22 devstack sudo[115083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:22 devstack sudo[115083]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.249s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:22 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-222f8ccb-3398-4652-9e5b-530483c32360 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-bb86c2b1-f2aa-4bb3-a99a-4bc4d8bdd30c-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94039) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (1e936b01-7255-40d3-bc3a-1b7c49004f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93893dd9-62bb-497e-b033-ddec088b5402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93893dd9-62bb-497e-b033-ddec088b5402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873252070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:15:23Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639e1584-b9ce-48e1-9342-6ddd57d28288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639e1584-b9ce-48e1-9342-6ddd57d28288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12220b82-d78d-4b4f-9ec8-d189443cdd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12220b82-d78d-4b4f-9ec8-d189443cdd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada', 'volume_name': 'volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9ab14c-1a58-4919-a79c-c31bbad5a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e9ab14c-1a58-4919-a79c-c31bbad5a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baeb1859-0585-4b3c-8b12-8ed0d49618c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:22 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Volume c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada', 'volume_size': 1} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-24T08:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-873252070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68eb3a64fe844fc085cf7adb04d6fa6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-24T08:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-24T08:15:23Z,use_quota=True,user_id='412ffada705d491589af4d3e234b93c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d99a35f-711b-4194-a26c-8d2ab1f5588f),volume_type_id=1d99a35f-711b-4194-a26c-8d2ab1f5588f)}" {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Creating volume c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Selected osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c as target Quobyte volume. {{(pid=94039) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 24 10:15:22 devstack cinder-volume[94039]: INFO cinder.volume.drivers.remotefs [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] casted to osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c Aug 24 10:15:22 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada 1073741824 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:22 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada 1073741824 Aug 24 10:15:22 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:23 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada 1073741824" returned: 0 in 0.416s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:23 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada Aug 24 10:15:23 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:23 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" returned: 0 in 0.240s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'} {{(pid=94039) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baeb1859-0585-4b3c-8b12-8ed0d49618c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada', 'volume_size': 1}' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472d5989-8a4f-4e6d-baf9-bbeacc958147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 24 10:15:23 devstack cinder-volume[94039]: INFO cinder.volume.flows.manager.create_volume [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Volume volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada (c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada): created successfully Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472d5989-8a4f-4e6d-baf9-bbeacc958147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94039) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Flow 'volume_create_manager' (1e936b01-7255-40d3-bc3a-1b7c49004f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94039) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 24 10:15:23 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-daf0c54c-e245-4459-ae6d-b80390df5d12 tempest-ProjectMemberTests-1824643926 None] Created volume successfully. Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Creating offline snapshot b45e6f98-5df4-4905-a938-4d3840d993a2 of volume c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea55aed7-d654-421f-98bb-caa3a1334dfc]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:23 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:24 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada Aug 24 10:15:24 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:24 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" returned: 0 in 0.360s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 1G {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:24 devstack sudo[115101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 1G Aug 24 10:15:24 devstack sudo[115101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:24 devstack sudo[115101]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 1G" returned: 0 in 0.381s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:24 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:24 devstack sudo[115107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 Aug 24 10:15:24 devstack sudo[115107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:25 devstack sudo[115107]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada -F qcow2 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2" returned: 0 in 0.295s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:25 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 is being set with open permissions: ugo+rw Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:25 devstack sudo[115112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 Aug 24 10:15:25 devstack sudo[115112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:25 devstack sudo[115112]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2" returned: 0 in 0.249s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:25 devstack sudo[115115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info Aug 24 10:15:25 devstack sudo[115115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:25 devstack sudo[115115]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info" returned: 0 in 0.250s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:25 devstack cinder-volume[94039]: WARNING cinder.volume.drivers.remotefs [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info is being set with open permissions: ugo+rw Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:25 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info Aug 24 10:15:25 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:25 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.info" returned: 0 in 0.247s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:25 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:25 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-f2a17bde-9976-4b28-a52a-7b1816f3cd31 tempest-ProjectMemberTests-1824643926 None] Create snapshot completed successfully Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-b45e6f98-5df4-4905-a938-4d3840d993a2-delete_snapshot" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-b45e6f98-5df4-4905-a938-4d3840d993a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" by "delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-b45e6f98-5df4-4905-a938-4d3840d993a2" by "_delete_snapshot" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-b45e6f98-5df4-4905-a938-4d3840d993a2" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Deleting offline snapshot b45e6f98-5df4-4905-a938-4d3840d993a2 of volume c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 24 10:15:26 devstack sudo[115121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:26 devstack sudo[115121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] snapshot_file for this snap is: volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 {{(pid=94039) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb7777f-9b1e-4350-9289-badb86a5e174]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:26 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 Aug 24 10:15:26 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:26 devstack sudo[115121]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.251s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_service.periodic_task [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] Running periodic task VolumeManager._thread_info {{(pid=94039) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread count: 28 {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.manager [None req-4d9d6bd3-25d1-49ed-a32f-4fe4b0e8b226 None None] thread info: [<_MainThread(MainThread, started 132166641606784)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94039) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 24 10:15:26 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2" returned: 0 in 0.388s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.remotefs [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94039) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1262a62-135f-4dd5-969e-b6db9ae5ec1f]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:26 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:26 devstack sudo[115129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada Aug 24 10:15:26 devstack sudo[115129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:27 devstack sudo[115129]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" returned: 0 in 0.356s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:27 devstack sudo[115134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 Aug 24 10:15:27 devstack sudo[115134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:27 devstack sudo[115134]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2" returned: 0 in 0.347s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:27 devstack sudo[115139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2 Aug 24 10:15:27 devstack sudo[115139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:27 devstack sudo[115139]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada.b45e6f98-5df4-4905-a938-4d3840d993a2" returned: 0 in 0.243s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-b45e6f98-5df4-4905-a938-4d3840d993a2" released by "_delete_snapshot" :: held 1.436s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" released by "delete_snapshot" :: held 1.481s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Created reservations ['01071792-208c-445c-82da-b56173fbdb41', '3e27e722-8cb5-4724-9908-4a0fe0e9b569', 'c1407c3c-0305-43a6-8d7d-27ec836b1368', 'c978e05e-9b33-4dec-8463-30a6da3ef9a0'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:27 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Delete snapshot completed successfully. Aug 24 10:15:27 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-5cb37a87-bd07-482d-9c14-e65ebae683b6 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-b45e6f98-5df4-4905-a938-4d3840d993a2-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada-delete_volume" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "cinder-quobyte-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" by "delete_volume" {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" acquired by "delete_volume" :: waited 0.014s {{(pid=94039) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2992d8c-6c2d-4d61-b997-d3a0e3abeeca]: (4, 'qcow2') {{(pid=95940) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:28 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada Aug 24 10:15:28 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:28 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" returned: 0 in 0.362s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:28 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:28 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada Aug 24 10:15:28 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:29 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130/volume-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" returned: 0 in 0.246s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-quobyte-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada" released by "delete_volume" :: held 0.667s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG cinder.quota [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Created reservations ['1296c070-9d22-4f66-9340-78f3b46cec21', 'e51116f7-572e-4023-86cf-680d19dedf45', '869f671c-95db-4e58-a281-89128b34a796', '50f01d54-6ea7-463f-8bd9-2414555b61f4'] {{(pid=94039) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c': None} {{(pid=94039) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG cinder.volume.drivers.quobyte [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4911dd4e-4bb0-4fee-a766-e95c25a01f5c'] {{(pid=94039) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.lockutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94039) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 24 10:15:29 devstack sudo[115150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130 Aug 24 10:15:29 devstack sudo[115150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 24 10:15:29 devstack sudo[115150]: pam_unix(sudo:session): session closed for user root Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG oslo_concurrency.processutils [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c1e16539e59010ac6280c083a11d6130" returned: 0 in 0.279s {{(pid=94039) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG cinder.manager [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Notifying Schedulers of capabilities ... {{(pid=94039) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 24 10:15:29 devstack cinder-volume[94039]: INFO cinder.volume.manager [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Deleted volume successfully. Aug 24 10:15:29 devstack cinder-volume[94039]: DEBUG cinder.coordination [None req-1edaa615-18b2-409f-a85b-f218170bfd06 tempest-ProjectMemberTests-1824643926 None] Lock "cinder-c5cd0a17-9b0a-4e56-9af1-37f7a82c7ada-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=94039) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 24 10:15:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=81,cinder:DELETE=9,cinder:UPDATE=95,cinder:INSERT=25 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 24 10:15:39 devstack cinder-volume[94039]: DEBUG dbcounter [-] [94039] Writing DB stats cinder:SELECT=68,cinder:UPDATE=94,cinder:INSERT=28,cinder:DELETE=6 {{(pid=94039) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}